Ingest - tweaks following group demo

[fvankrieken]

Follow up to #1166. Primarily,

• separate out default processing step logic into helper
• clean up language "processing" vs "preprocessing" (make consistent)
• raise not implemented for custom script
• publish json schema

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 68.60%. Comparing base (90497a2) to head (67be0be).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1202      +/-   ##
==========================================
+ Coverage   67.84%   68.60%   +0.75%     
==========================================
  Files         110      109       -1     
  Lines        5847     5771      -76     
  Branches      641      634       -7     
==========================================
- Hits         3967     3959       -8     
+ Misses       1754     1685      -69     
- Partials      126      127       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[alexrichey]

Curious your rationale on adding a new bucket vs having all our schemas colocated. Just thinking that if we keep adding schemas, not sure they'll be 1-1 with buckets.

[fvankrieken]

Yeah, I agree with that, it just on one level made sense to have them in the same place as all the objects that refer to them. But I'm with you - this should really just live in one place

[fvankrieken]

And maybe we move it somewhere more "neutral" but that place can be publishing for now

[fvankrieken]

fixed in new commit

[alexrichey]

Looks great