tap-nasa

Singer tap for the NASA Astronomy Picture of the Day API.

Built with the Meltano Tap SDK for Singer Taps.

Capabilities

• catalog
• state
• discover
• about
• stream-maps
• schema-flattening
• batch

Supported Python Versions

• 3.10
• 3.11
• 3.12
• 3.13
• 3.14

Settings

Setting	Required	Default	Description
api_key	True	None	API Key for NASA
start_date	True	None	Earliest datetime to get data from

Built-in settings

The following settings are supported by the SDK and are automatically included in this tap.

Setting	Required	Default	Description
stream_maps	False	None	Config object for stream maps capability. For more information check out Stream Maps.
stream_map_config	False	None	User-defined config values to be used within map expressions.
faker_config	False	None	Config for the Faker instance variable fake used within map expressions. Only applicable if the plugin specifies faker as an addtional dependency (through the singer-sdk faker extra or directly).
faker_config.seed	False	None	Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator
faker_config.locale	False	None	One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization
flattening_enabled	False	None	'True' to enable schema flattening and automatically expand nested properties.
flattening_max_depth	False	None	The max depth to flatten schemas.
batch_config	False	None
batch_config.encoding	False	None	Specifies the format and compression of the batch files.
batch_config.encoding.format	False	None	Format to use for batch files.
batch_config.encoding.compression	False	None	Compression format to use for batch files.
batch_config.storage	False	None	Defines the storage layer to use when writing batch files
batch_config.storage.root	False	None	Root path to use when writing batch files.
batch_config.storage.prefix	False	None	Prefix to use when writing batch files.

A full list of supported settings and capabilities is available by running: tap-nasa --about

Source Authentication and Authorization

Visit https://api.nasa.gov/#signUp and request an API key.

Usage

You can easily run tap-nasa by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-nasa --version
tap-nasa --help
tap-nasa --config CONFIG --discover > ./catalog.json

Developer Resources

Initialize your Development Environment

pipx install hatch

Create and Run Tests

Run integration tests:

hatch run test:integration

You can also test the tap-nasa CLI interface directly:

hatch run sync:console -- --about --format=json

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Your project comes with a custom meltano.yml project file already created. Go ahead and install Meltano if you haven't already.

1. Install all plugins

   meltano install

2. Check that the extractor is working properly

   meltano invoke tap-nasa --version

3. Execute an ELT pipeline

   meltano run tap-nasa target-jsonl

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.

Tox usage

You can use tox to run tests, type checks, and dependency checks in isolated environments. This is especially useful for ensuring consistency across different Python versions and setups.

List all available environments:

tox -av

Run tests for a specific Python version (e.g., 3.10):

tox -e 3.10

Check typing with mypy:

tox -e typing

Check dependencies with deptry:

tox -e dependencies

You can also run all environments in parallel:

tox run-parallel