Automating data pre-processing requires (You guessed it) metadata
scalingbiotech.substack.com
Recently, on this journey backwards through the user cases that biotech software needs to support, I discussed custom/interactive analysis. But when you get to the point that you're seeing the same kinds of experiments, readouts and analysis over and over again, you'll probably want to start automating the early/pre-processing stages of this analysis - evaluating data quality, running primary analysis, etc. This feels like a natural extension of the data transfer stage (which I'll cover next week). But it turns out the biggest bottleneck to making this happen usually isn't the data but rather, following the recurring theme on this newsletter, the metadata. And that’s what I want to discuss this week.
Automating data pre-processing requires (You guessed it) metadata
Automating data pre-processing requires (You…
Automating data pre-processing requires (You guessed it) metadata
Recently, on this journey backwards through the user cases that biotech software needs to support, I discussed custom/interactive analysis. But when you get to the point that you're seeing the same kinds of experiments, readouts and analysis over and over again, you'll probably want to start automating the early/pre-processing stages of this analysis - evaluating data quality, running primary analysis, etc. This feels like a natural extension of the data transfer stage (which I'll cover next week). But it turns out the biggest bottleneck to making this happen usually isn't the data but rather, following the recurring theme on this newsletter, the metadata. And that’s what I want to discuss this week.