tap-stackoverflow-sampledata

Stack Overflow Sample Data

tap-stackoverflow-sampledata (buzzcutnorman variant)

Tap for the Stack Overflow XML dump files available at Archive.org. Intended as a loader plugin testing aid.

The tap-stackoverflow-sampledata extractor pulls data from Stack Overflow Sample Data that can then be sent to a destination using a loader.

Getting Started

Prerequisites

If you haven't already, follow the initial steps of the Getting Started guide:

Installation and configuration

Add the tap-stackoverflow-sampledata extractor to your project using
```
meltano add
```
:

meltano add extractor tap-stackoverflow-sampledata

Configure the tap-stackoverflow-sampledata settings using

meltano config

meltano config tap-stackoverflow-sampledata set --interactive

Test that extractor settings are valid using

meltano config

meltano config tap-stackoverflow-sampledata test

Next steps

Follow the remaining steps of the Getting Started guide:

If you run into any issues, learn how to get help.

Capabilities

The current capabilities for tap-stackoverflow-sampledata may have been automatically set when originally added to the Hub. Please review the capabilities when using this extractor. If you find they are out of date, please consider updating them by making a pull request to the YAML file that defines the capabilities for this extractor.

This plugin has the following capabilities:

discover

You can override these capabilities or specify additional ones in your meltano.yml by adding the capabilities key.

Settings

The tap-stackoverflow-sampledata settings that are known to Meltano are documented below. To quickly find the setting you're looking for, click on any setting name from the list:

stackoverflow_data_directory
batch_config.encoding.format
batch_config.encoding.compression
batch_config.storage.root
batch_config.storage.prefix

You can also list these settings using

meltano config

with the list subcommand:

meltano config tap-stackoverflow-sampledata list

You can override these settings or specify additional ones in your meltano.yml by adding the settings key.

Please consider adding any settings you have defined locally to this definition on MeltanoHub by making a pull request to the YAML file that defines the settings for this plugin.

Data Directory (stackoverflow_data_directory)

Environment variable: TAP_STACKOVERFLOW_SAMPLEDATA_STACKOVERFLOW_DATA_DIRECTORY

A path to the StackOverflow XML data files.