Experiments and their analysis should be reproducible, and all data/figures in a
paper should be reviewable. Pipelines (e.g. snakemake
files) to generated them
should be attached to the paper.
I’ve asked for automated scripts to reproduce test data on 3+ github repositories now, and got a satisfactory answer zero times:
WFA: https://github.com/smarco/WFA/issues/26
Link to a datadump on the block-aligner repository. Good to have actual data, but exactly how this data was created is unclear to me.
WFAlm: https://github.com/jeizenga/wfalm/issues/6
Some manual scripts to be invoked – high probability of manual error, and I have to use tools I do not fully understand since I have not used them before.
BiWFA: https://github.com/smarco/BiWFA-paper/issues/1 (pending)