in silico
Phase 1: In Silico Validation
- Objective
- To rapidly falsify the core hypothesis using synthetic data, specifically testing whether the AFFL mechanism can separate spectrally overlapping signals under controlled conditions, and to identify the minimum SOR threshold where the approach fails.
- Estimated cost
- €500-2000
- Estimated duration
- 4-6 weeks
- Success criteria
- SSA improvement over baselines · AFFL achieves a mean RMSE reduction of ≥15% compared to the best baseline (LSTM or wavelet) at SOR=0.5 and SNR=20 dB, with p<0.05 in a paired t-test. · (Compute RMSE for each of the 100 synthetic time series per condition, then perform paired t-tests.)
- TEE at high SOR · AFFL achieves TEE < 0.05 m/year at SOR=0.8, while the wavelet filter has TEE > 0.15 m/year under the same conditions. · (Estimate the linear trend from the reconstructed pumping signal and compare to the known true trend.)
- Minimum viable SOR · Identify the SOR value (SOR_min) below which AFFL’s performance degrades to within 5% of the LSTM baseline. This SOR_min must be > 0.7 for the hypothesis to hold. · (Interpolate the performance curve of AFFL vs. SOR to find the crossing point.)
- Go if
- All three success criteria are met (SSA improvement, TEE at high SOR, SOR_min > 0.7).
- No-go if
- AFFL fails to beat the LSTM baseline at SOR=0.5 (criterion 1 not met) OR SOR_min < 0.5, indicating the method is too fragile.
- Pivot if
- If AFFL works but only with the physical constraint penalty, pivot to a “physics-informed” AFFL variant. If AFFL fails on synthetic data, pivot to a different deep learning architecture (e.g., a transformer-based filter).
- Risks
- The AFFL overfits to the synthetic data and the learned filters are not generalizable.Probability: mediumMitigation: Use a separate validation set for hyperparameter tuning. Add dropout and weight decay. Test on a hold-out set of synthetic data generated with different random seeds.
- The STFT with a 365-day window is too coarse to separate signals with overlapping frequencies.Probability: mediumMitigation: Test with alternative window sizes (e.g., 180, 730 days) and different hop lengths. Implement a multi-resolution STFT (like a wavelet packet transform) as a fallback.
- The LSTM baseline is too weak, making the comparison unfair.Probability: lowMitigation: Use a state-of-the-art LSTM architecture (e.g., with attention) and tune it properly. Also include a second strong baseline: a 1D U-Net for time series.