Skip to content

Library updates#8

Open
rdeshmukh15 wants to merge 22 commits intoenvoy:masterfrom
singer-io:library-updates
Open

Library updates#8
rdeshmukh15 wants to merge 22 commits intoenvoy:masterfrom
singer-io:library-updates

Conversation

@rdeshmukh15
Copy link
Copy Markdown

No description provided.

Kyle Allan and others added 22 commits June 10, 2019 18:35
Merge fork into master
* use elif

* Add stream selection

* changed reference from catalog object to stream

* added field selection

* fixed bug

* add a todo about replication_keys
* Run on Circle without private Docker image

* Extract channel list in to a generator

* Allow user to disable private channels

By default, we will still get private channels. This requires the extra
`groups:` scopes.

Previously, even if we didn't want to sync private groups, the calls to
the Slack API would fail as the calls we made defined the types as
`"public_channel,private_channel"`.

There is now an optional config, `private_channels`, that allows the
user to disable private channels in the config file.

Also added documentation for the config file.

* Allow user to specify specific channels

* Added Streams:
- Files
- Remote Files
- Threads
- User Groups
- Teams

Updated Streams:
- Channels
- Channel Members
- Messages

* Adopted a parent/child stream relationship for Messages and Threads.
* Added bookmarking for all Incremental Streams.

* Adding more documentation, fixing pylint issues.

* * Changed up error handling to consolidate into new SlackClient
* Added basic tap tester framework
* Changed circle yml to reflect tap tester framework
* More documentation

* * Fix schema and transformation of channels stream.

* * Better documentation for Date windowing in README.md
* Public Channel Auto-Join now only joins channels that are specified if a channel list is provided via the config.

* changed circlefile to run python 3.6.9

* added awscli to setup.py dev

* added awscli to circleci setup, removed from dev dependencies

* add pip install to circle config file

* removed pip install from config

* got tests passing

* commited circleci

* bumped minor version

* made major version bump

* "to push circle"

* added to changelog

Co-authored-by: Andrew Jones <andrew@andrew-jones.com>
Co-authored-by: Andrew Jones <andrewjones@gocardless.com>
Co-authored-by: Nick Civili <nick.civili@bytecode.io>
Co-authored-by: Kyle Speer <kspeer@stitchdata.com>
Co-authored-by: Kyle Speer <kspeer@stitchdata.com>
* Update README.md

add Slack scope: `users:read.email`

* add email to users.json
* Remove unused pipefile.lock

* Update tap-tester image version

* Remove explicit python installation in circleci

* Increase date_window size

* Update changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants