Experiments and their analysis should be reproducible, and all data/figures in a
paper should be reviewable. Pipelines (e.g. snakemake files) to generated them
should be attached to the paper.
I’ve asked for automated scripts to reproduce test data on 3+ github repositories now, and got a satisfactory answer zero times:
- WFA: https://github.com/smarco/WFA/issues/26 - Link to a datadump on the block-aligner repository. Good to have actual data, but exactly how this data was created is unclear to me. 
- WFAlm: https://github.com/jeizenga/wfalm/issues/6 - Some manual scripts to be invoked – high probability of manual error, and I have to use tools I do not fully understand since I have not used them before. 
- BiWFA: https://github.com/smarco/BiWFA-paper/issues/1 (pending)