CMS MiniAOD Basic Support, ATLAS R22 Support

Two main features:

• R22 support in ATLAS. This is now verified for PHYS. Some work remains to be done to verify PHYSLITE
• CMS MiniAOD backend

This should be backwards compatible with everything that has gone before.

Many thanks to everyone that contributed to this release!!

What's Changed

• Enabled MiniAOD Backend for func_adl by @hswhhe in #199
• Adding R22 Support by @gordonwatts in #200
• Remove all use of .format by @gordonwatts in #201
• Docker image info to local runner by @gordonwatts in #203
• Quoted strings for lambda removed. by @gordonwatts in #204
• Get the CI Working by @gordonwatts in #207

New Contributors

• @hswhhe made their first contribution in #199

Full Changelog: 2.0.1...2.1

CMS MiniAOD support and ATLAS xAOD R22 Support

Two big changes in this release:

• CMS MiniAOD support (Run 2) is enabled. Only a limited number of collections, etc., are present - need a full type system run for it.
• ATLAS xAOD R22 is also supported. Same problems, however - only a limited number of collections are supported until full type support is enabled (in the front ends). This was done in a way as R21 and R22 code is common - so other than switching the transformer tag, R22 should run without any new servicex installation (and works locally).

There was also a set of work cleaning up the codebase (with lots more to do!). There was also some work done so that one can use MetaData to specify the transformer image. This works with LocalFile, and will eventually be lit up for servicex.

What's Changed

• Enabled MiniAOD Backend for func_adl by @hswhhe in #199
• Adding R22 Support by @gordonwatts in #200
• Remove all use of .format by @gordonwatts in #201
• Docker image info to local runner by @gordonwatts in #203
• Quoted strings for lambda removed. by @gordonwatts in #204

New Contributors

• @hswhhe made their first contribution in #199

Full Changelog: 2.0.1...2.1b1

CMS Generation Bug Fixes

What's Changed

• Bug Fixes for CMS Production Run by @gordonwatts in #197

Full Changelog: 2.0...2.0.1

CMS Code Generation

• More carefully protect the results copy out location

CMS Code Generation

• CMS code generation template include file fix

Protect file copy out

• More carefully protect where we copy the result file

2.0

This is a major release. It should continue to run older queries without modification. New features (like MetaData) are only partially supported by the CMS backend for now.

New Features

Interface Features

• Local running is now supported, as long as docker is installed. For ATLAS containers, a local datavolume is also mounted so calibration files do not have to be repeatedly downloaded.

Code Generation Features

• MetaData to completely define an object model for events, including all types. This can be sent over the wire meaning when there are changes to the underlying container this is running on, the code generator no longer has to be updated.
• One can now inject job options into ATLAS jobs via MetaData (supporting, for example, object corrections)
• Strings are now first-class citizens and can be returned from queries

The PR's

• Support MetaData by @gordonwatts in #177
• Add JobOptions Injection by @gordonwatts in #180
• Link Libraries attached to collections by @gordonwatts in #183
• Fixes the event info bug by @gordonwatts in #184
• Enable Local Dataset Running by @gordonwatts in #185
• MetaData Improvements by @gordonwatts in #186
• Fix First scoping bug by @gordonwatts in #187
• Merge Common Body MD by @gordonwatts in #188
• Support bool constants in the code by @gordonwatts in #189
• Code Injection Improvements by @gordonwatts in #190
• Strings Are First Class Citizen by @gordonwatts in #192
• Mount a docker volume as cache by @gordonwatts in #194
• Build working with new ast packages by @gordonwatts in #195
• Improvements for Production by @gordonwatts in #196

Full Changelog: 1.4.1...2.0

Reset state between queries

Owning up to the problem we have a global state in the executor. Make sure it gets reset between calls.

Improve error messages

• When duplicate meta_data blocks that should be the same but aren't, give the user some hint as to what we are looking at.

2.0b1

What's Changed

• Support MetaData by @gordonwatts in #177
• Add JobOptions Injection by @gordonwatts in #180
• Link Libraries attached to collections by @gordonwatts in #183
• Fixes the event info bug by @gordonwatts in #184
• Enable Local Dataset Running by @gordonwatts in #185
• MetaData Improvements by @gordonwatts in #186
• Fix First scoping bug by @gordonwatts in #187
• Merge Common Body MD by @gordonwatts in #188
• Support bool constants in the code by @gordonwatts in #189
• Code Injection Improvements by @gordonwatts in #190
• Strings Are First-Class Citizen by @gordonwatts in #192
• Mount a docker volume as a cache by @gordonwatts in #194
• Build working with new ast packages by @gordonwatts in #195

Full Changelog: 1.4.1...2.0b1