in silico
Phase 1: In Silico Validation
- Objective
- To rapidly falsify the core hypothesis using public data and computational simulations, at minimal cost, before committing to wet-lab or expensive compute resources.
- Estimated cost
- €500-2000
- Estimated duration
- 4-6 weeks
- Success criteria
- ΔBAcc (CLR vs RMA) for TCGA-BRCA with LASSO · ≥ 8 pp, with 95% CI lower bound ≥ 5 pp · (Paired one-sided t-test on 50 BAcc differences (10 repeats × 5 folds), α=0.01, BH-corrected)
- Feature count reduction (CLR vs RMA) for LASSO on TCGA-BRCA · Median reduction ≥ 40% (i.e., N_features(CLR) ≤ 0.6 × N_features(RMA)) · (Wilcoxon signed-rank test (paired, one-sided), α=0.01)
- FPR reduction (CLR vs RMA) in simulated DE detection · FPR(CLR) ≤ 0.5 × FPR(RMA) and absolute FPR(CLR) < 0.05 · (Paired one-sided t-test on logit-transformed FPRs across 100 simulations, α=0.01)
- Cellularity correlation (|r| between ΔBAcc and ESTIMATE) · |r| < 0.3, with 95% CI upper bound < 0.5 · (Fisher z-transformation test for correlation, one-sided (testing |r| < 0.3), α=0.05)
- ΔBAcc on Arabidopsis dataset · ≥ 5 pp, with 95% CI lower bound ≥ 2 pp · (One-sample one-sided t-test on 50 ΔBAcc values, α=0.01)
- Go if
- All 5 success criteria are met (i.e., all null hypotheses rejected in the predicted direction).
- No-go if
- Any 2 or more success criteria fail (i.e., null hypothesis not rejected, or effect in opposite direction).
- Pivot if
- Exactly 1 success criterion fails; then investigate why (e.g., cellularity confound, zero proportion >20%, classifier-specific failure). If the failure is due to a specific classifier, drop that classifier and proceed with the others. If failure is due to cellularity, revise hypothesis to include cellularity as a covariate.
- Risks
- Zero proportion >20% in some TCGA datasets (e.g., lowly expressed genes), causing CLR instability.Probability: mediumMitigation: Use Bayesian imputation (zCompositions) and test sensitivity; if still unstable, filter genes with >20% zeros and report. If filtering reduces p < 10,000, consider the hypothesis invalid for that dataset.
- Computational cost of LSTM-DBN training on 50,000 genes × 500 samples may exceed workstation capacity.Probability: mediumMitigation: Use dimensionality reduction (PCA to 100 components) before LSTM-DBN; report if results differ from full gene set. Alternatively, use cloud GPU instances (AWS p3.2xlarge, ~$3/hour).
- Arabidopsis dataset may not have exactly 4 conditions or n=100; GEO data may be incomplete.Probability: lowMitigation: Use any plant stress dataset with ≥4 conditions and n≥30 per condition from GEO; if not available, substitute with a mouse brain region dataset (e.g., GSEXXXX).
- Simulation may not capture real data complexity (e.g., batch effects, non-linear dependencies).Probability: mediumMitigation: Use `splatter` with parameters estimated from real TCGA data (e.g., dropout rate, library size variability). Also test with a second simulation using a Dirichlet-multinomial model.