Reduce size of data files in Endom

[fingolfin]

• use gzip -9 to get maximal compression
• remove superfluous whitespace inside

This reduces the size of the directory from 50M to 26M for me.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.85%. Comparing base (58a9b9f) to head (b740da0).
⚠️ Report is 4 commits behind head on master.

Additional details and impacted files

@@           Coverage Diff           @@
##           master      #23   +/-   ##
=======================================
  Coverage   99.85%   99.85%           
=======================================
  Files           5        5           
  Lines         709      709           
=======================================
  Hits          708      708           
  Misses          1        1           

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[olexandr-konovalov]

Cool! I didn't inspect the changes, but perhaps @raemarina and @IrynaRaievska can pick up a random file to compare? I presume you have used some shell script to process all data?

[ChrisJefferson]

I was looking at possible another way to squish this, which particularly helps for the larger files, while still keeping them fairly easy to understand, will report soon.

[fingolfin]

@olexandr-konovalov yes, a very simply script, basically gunzip Endom/*/*.gz, followed by invoking perl/sed/whatever to remove all spaces (except spaces where to the left and right there are letter, to avoid mucking up the return statement at the end of each file), and then finally gzip -9 -n Endom/*/*.txt

But of course it seems @ChrisJefferson has done something even better, nice. (Makes me wonder if the same technique maybe also would apply to the additional data files on Zenodo)

[fingolfin]

Closing in favor of PR #38