Changelog 2019 and 2020
Welcome to the 2019 and 2020 changelog for the dbt Cloud application! You can use this changelog to see the highlights of what was new, fixed, and enhanced during this time period.
dbt Cloud v1.1.16 (December 23, 2020)
This release adds preview support for Databricks Spark in dbt Cloud and adds two new permission sets for Enterprise acccounts.
Enhancements
- Added preview support for Databricks Spark support
- Added two new Enterprise permission sets: Account Viewer and Project Creator
Fixed
- Improve logging infrastructure for dbt run logs
- Fix for SSH tunnel logging errors
dbt Cloud v1.1.15 (December 10, 2020)
Lots of great stuff to confer about this go-round: things really coalesced this week! Lots of excitement around adding Spark to the connection family, as well as knocking out some longstanding bugs.
Enhancements
- Add Spark as an option for database setup
Fixed
- Fix this one hairy bug where one email could have multiple user accounts
- Fix setup-connection react-page routing
- Break out group selection logic from license types and group names
- Handle json errors in v1/v2 body parsing
- Handle AuthForbidden and AuthCancelled graciously - ie, not throw 500s
- Fix regression with IDE loading spinner
dbt Cloud v1.1.14 (November 25, 2020)
This release adds a few new pieces of connective tissue, notably OAuth for BigQuery and SparkAdapter work. There are also some quality of life improvements and investments for the future, focused on our beloved IDE users, and some improved piping for observability into log management and API usage.
Enhancements
- Update IP allowlist
- User can OAuth for BigQuery in profile credentials
- Adding SparkAdapter backend models, mappers and services
- Added BigQuery OAuth integration
- Adding db index for owner_thread_id
Fixed
- Fix post /run error rate
- Fix bug where bad argument was passed to dbt runs
- Log out unhandled error in environment variable context manager
- Remove account settings permissions for user integrations
dbt Cloud v1.1.13 (November 12, 2020)
This release adds support for triggering runs with overriden attributes via the triggerRun API endpoint. Additionally, a number of bugs have been squashed and performance improvements have been made.
Enhancements
- Improve error handling for long-running queries in the IDE
- Use S3 client caching to improve log download speed for scheduled runs
- Support triggering jobs with overriden attributes from the API
- Clarify "upgrade" copy on the billing page
Fixed
- GitLab groups endpoint now returns all groups and subgroups
- Support BigQuery retry configs with value 0
- Prevent web IDE from crashing after running an invalid dbt command
- Apply additional log scrubbing to filter short-lived git credentials
- Fix older migration to make auth_url field nullable
- Support paths in GitLab instance URL
- Fix for auth token request url in GitLab oauth flow
dbt Cloud v1.1.12 (October 30, 2020)
This release adds dbt v.18.1 and 0.19.0b1 to dbt Cloud. Additionally, a number of bugs have been fixed.
Enhancements
- Update copy on billing page for picking a plan at the end of a trial
- Improved authorization for metadata API
- Add dbt 0.19.0b1
- Add dbt 0.18.1
Fixed
- Fixed an issue where groups from other logged-in accounts appeared in the RBAC UI
- Fixed requested GitLab scopes and an issue when encrypting deploy tokens for GitLab auth
- Fixed an issue where null characters in logs threw errors in scheduled runs
dbt Cloud v1.1.11 (October 15, 2020)
Release v1.1.11 includes some quality-of-life enhancements, copy tweaks, and error resolutions. It also marks the last time we'll have the same digit four times in a row in a release until v2.2.22.
Enhancements
- Add InterfaceError exception handling for commands
- Rename My Account --> Profile
- Add project and connection to admin backend
Fixed
- Resolve errors from presence of null-characters in logs
- Email verifications backend
- Undo run.serialize
- Fix error while serialized run
- Fix logic error in connection setup
- Fix a bug with GitLab auth flow for unauthenticated users
- Fix bug where Native Okta SSO uses the wrong port
dbt Cloud v1.1.10 (October 8, 2020)
This release adds support for repositories imported via GitLab (Enterprise) and contains a number of bugfixes and improvements in the dbt Cloud IDE.
Enhancements
- Add Gitlab integration (Enterprise)
- Add GitLab repository setup to project setup flow (Enterprise)
- Add GitLab automated Deploy Token installation (Enterprise)
- Add dbt 0.18.1rc1
Fixed
- Fix bug where IDE gets stuck after changing project repository
- Fix race condition where connections can be added to the wrong project
- Fix revoking email invites
- Fix a bug in slim CI deferring run search where missing previous run caused the scheduler to raise an error
- Fix a source of IDE instability
- Gracefully clean up IDE backend on shutdown
- Always show SSO mappings on Group Details page
dbt Cloud v1.1.9 (October 1, 2020)
This release adds the ability for admins on the Enterprise plan to configure the Role Based Access Control permissions applied to Projects in their account. Additionally, job execution deferral is now available behind a feature flag, and a number of fixes and improvements were released as well.
Enhancements
- Add dbt Cloud version in the navigation sidebar
- Add RBAC Group Permission view, create, and modify UIs
- Add personal git auth for IDE error handling modals
- Add Develop Requests to backend views
- Implemented job execution deferral
- Add support for dbt v0.18.1b2
Fixed
- Fixed the scenario where interacting with the Refresh IDE button causes an index.lock file to remain in the IDE file system
- Validate PR URL for XSS attempts
- Address RBAC inconsistencies
- Fixed users not being able to update their dbt Cloud password in-app
- Fix for applying user permissions across multiple accounts after SSO auth
- Google API: default to common api endpoint but allow override
- Fix for missing email variable in GSuite debug logging
- Destroy IDE session when switching projects
dbt Cloud v1.1.8 (September 17, 2020)
This release adds native support for Okta SSO and dbt v0.18.0. It also adds initial support for a GitLab integration and self-service RBAC configuration.
Enhancements
- Add dbt 0.18.0
- Add native Okta SSO support
- Add additional logging for Gsuite and Azure SSO
- Add git cloning support via GitLab deploy tokens for scheduled runs (coming soon)
- add RBAC Groups Detail Page and Groups List UIs
Fixed
- Allow
*_proxy
env vars in scheduled runs
dbt Cloud v1.1.7 [September 3, 2020]
This release adds a Release Candidate for dbt v0.18.0 and includes bugfixes and improvements to the Cloud IDE and job scheduler.
Enhancements
- Improve scheduler backoff behavior
- Add dbt 0.18.0rc1
- Add support for non-standard ssh ports in connection tunnels
- Add support for closing the IDE filesystem context menu by clicking outside the menu
Fixed
- Fix for joining threads in run triggers
- Fix thread caching for s3 uploads
dbt Cloud v1.1.6 (August 20, 2020)
This release includes security enhancements and improvements across the entire dbt Cloud application.
Enhancements
- Support for viewing development docs inside of the IDE (docs
- Change CI temporary schema names to be prefixed with
dbt_cloud
instead ofsinter
- Change coloring and iconography to improve accessibility and UX across the application
- [Enterprise] Support the specification of multiple authorized domains in SSO configuration
- [On-premises] Upgrade boto3 to support KIAM authentication
Fixed
- [Enterprise] Fix for missing IdP group membership mappings when users belong to >100 Azure AD groups
- Disallow the creation of symlinks in the IDE
- Improve reliability of background cleanup processes
- Improve performance and reliability of artifact management and PR webhook processing
dbt Cloud v1.1.5 (August 4, 2020)
This release adds a major new feature to the IDE: merge conflict resolution!
It also includes changes to the job scheduler that cut the time and resource utilization significantly.
Enhancements
- Add dbt 0.17.2
- Add dbt 0.18.0 beta 2
- Add merge conflict resolution, a merge commit workflow, and merge abort workflow to the IDE
- Deprecate dbt versions prior to 0.13.0
- Refactor to cut job scheduler loop time
- Reduce extra database calls to account table in job scheduler loop
- [On-premises] Allow clients to disable authentication for SMTP
- [On-premises] Allow disabling of TLS for SMTP
- [On-premises] Making k8s access mode for IDE pods an environment variable
- [Security] Force session cookie to be secure
- Make api and admin modules flake8 complaint
Fixed
- Fix incorrect usage of
region_name
in KMS client - Fix a call to a deprecated Github API
- Remove extraneous billing API calls during job scheduler loop
- Fix error where refreshing the IDE would leave running dbt processes in a bad state
dbt Cloud v1.1.4 (July 21, 2020)
This release dramatically speeds up the job scheduler. It adds a new stable dbt version (0.17.1) and a new prerelease (0.17.2b1), and it includes a number of bugfixes.
Enhancements
- Add dbt 0.17.2b1
- Add dbt 0.17.1 and set as default version
- Speed up job scheduler by 50%
- Added generate docs to rpc service and new view docs route
- Queue limiting by account for scheduled jobs
Fixed
- Fix enterprise SSO configuration when old Auth0 Azure AD is configured
- Do not schedule jobs for deleted job definitions or environments
- Fix permissions issues
- Fix a bug with metadata set in azure storage provider
- Fixed error when switching to developer plan from trial
- Fix authentication bug where we setup all accounts with same domain
- [Security] Add security check to prevent potentially malicious html files in dbt docs
dbt Cloud v1.1.3 (July 7, 2020)
This release contains a number of IDE features and bugfixes, a new release candidate of dbt, and a brand new Enterprise Single-Sign On method: Azure Active Directory!
Enhancements
- Add dbt 0.17.1rc3
- Snowflake: Add support for
client_session_keep_alive
config - Enterprise: Native Azure Oauth2 for Enterprise accounts
- IDE: Add custom command palette for finding files
Fixed
- Do not run CI builds for draft PRs in GitHub
- Remove race condition when syncing account with stripe billing events
- Enterprise: Fixed JIT provisioning bug impacting accounts with shared IdP domains
- IDE: Fix a regression with Github git clone method
- IDE: Fix a race condition where git clone didn't complete before user entered IDE
- IDE: Fix bug with checking out an environment custom branch on IDE refresh
- Bigquery: Fix PR schema dropping
dbt Cloud v1.1.2 (June 23, 2020)
This branch includes an important security fix, two new versions of dbt, and some miscellaneous fixes.
Enhancements
- Add project names to the account settings notifications section
- Add dbt 0.17.1 release candidate
- Update development dbt version to Marian Anderson
- Add remember me to login page and expire user sessions at browser close
- Adding Auth Provider and enabling Gsuite SSO for enterprise customers
Fixed
- [Security] Fix intra-account API key leakage
- Support queries containing unicode characters in the IDE
dbt Cloud v1.1.1 (June 9, 2020)
This release includes dbt 0.17.0 and a number of IDE quality of life improvements.
Enhancements
- Added dbt 0.17.0
- Added the ability to create a new folder in the IDE
- Added gitignore status to file system and display dbt artifacts, including directories dbt_modules, logs and target
- (Cloud only) Added rollbar and update some various error handling clean up
- (On-premises only) Admin site: allow Repository's Pull Request Template field to be blank
- (On-premises only) Added AWS KMS support
Fixed
- Expires old pending password reset codes when a new password reset is requested
dbt Cloud v1.1.0 (June 2, 2020)
This release adds some new admin backend functionality, as well as automatic seat usage reporting.
On-Premises Only
Added
- Added automatic reporting of seat usage.
Changed
- Admins can now edit remote URLs for repository in the admin backend.
- Admins can now edit credentials in the admin backend.
dbt Cloud v1.0.12 (May 27, 2020)
This release contains a few bugfixes for the IDE and email notifications, as well as the latest release candidate of 0.17.0.
All versions
Added
- Use the correct starter project tag, based on dbt version, when initializing a new project in the IDE
- Added branch filtering to IDE git checkout UI.
- Added dbt 0.17.0-rc3.
Fixed
- Fixed source freshness report for dbt version v0.17.0
- Fixed issue with checking-out git branches
- Fixed issue of logs being omitted on long running queries in the IDE
- Fixed slack notifications failing to send if email notifications fail
On-Premises Only
Added
- Added an Admin page for deleting credentials.
dbt Cloud v1.0.11 (May 19, 2020)
This version adds some new permission sets, and a new release candidate of dbt.
All versions
Added
- Added permission sets for Job Viewer, Job Admin and Analyst.
- Added dbt 0.17.0-rc1
dbt Cloud v1.0.10 (May 11, 2020)
All versions
Added
- Added dbt 0.17.0-b1.
- PR Url is now self serve configurable.
- Added more granular permissions around creating and deleting permissions. (Account Admin can create new projects by default while both Account Admin and Project Admin can delete the projects they have permissions for by default)
- Added an error message to display to users that do not have permissions set up for any projects on an account.
Fixed
- Removed .sql from csv download filename
- Fixed breaking JobDefinition API with new param custom_branch_only
- Fixed IDE query table column heading casing
dbt Cloud v1.0.9 (May 5, 2020)
This release includes bugfixes around how permissions are applied to runs and run steps, fixes a bug where the scheduler would hang up, and improves performance of the IDE.
All versions
Fixed
- Fixed permission checks around Runs and Run Steps, this should only affect Enterprise accounts with per-project permissions.
- Fixed receiving arbitrary remote_url when creating a git url repository.
- Fixed issue when handling non-resource specific errors from RPC server in IDE.
- Fixed a bug where the scheduler would stop if the database went away.
- Fixed IDE query results table not supporting horizontal scrolling.
Changed
- Improve IDE query results performance.
- Allow configuration on jobs to only run builds when environment target branch is env's custom branch.
- Allow configuration of GitHub installation IDs in the admin backend.
On-Premises Only
Fixed
- Fixed logic error for installations with user/password auth enabled in an on-premises context
dbt Cloud v1.0.8 (April 28, 2020)
This release adds a new version of dbt (0.16.1), fixes a number of IDE bugs, and fixes some dbt Cloud on-premises bugs.
All versions
Added
- Add dbt 0.16.1
Fixed
- Fixed IDE filesystem loading to check for directories to ensure that load and write methods are only performed on files.
- Fixed a bug with generating private keys for connection SSH tunnels.
- Fixed issue preventing temporary PR schemas from being dropped when PR is closed.
- Fix issues with IDE tabs not updating query compile and run results.
- Fix issues with query runtime timer in IDE for compile and run query functions.
- Fixed what settings are displayed on the account settings page to allign with the user's permissions.
- Fixed bug with checking user's permissions in frontend when user belonged to more than one project.
- Fixed bug with access control around environments and file system/git interactions that occurred when using IDE.
- Fixed a bug with Environments too generously matching repository.
Changed
- Make the configured base branch in the IDE read-only.
- Support configuring groups using an account ID in the admin backend.
- Use gunicorn webserver in IDE.
- Allow any repository with a Github installation ID to use build-on-PR.
- Member and Owner Groups are now editable from admin UI.
On-Premises Only
Fixed
- Fixed an issue where account license counts were not set correctly from onprem license file.
- Fixed an issue where docs would sometimes fail to load due to a server error.
dbt Cloud v1.0.7 (April 13, 2020)
This release rolls out a major change to how permissions are applied in dbt Cloud's API. It also adds some minor bugfixes, and some tooling for improved future QA.
All versions
Added
- Added support to permission connections on a per project basis.
- Added support to permission credentials on a per project basis.
- Added support to permission repositories on a per project basis.
- Smoke tests for account signup, user login and basic project setup
- Add dbt 0.16.1rc1
- Non-enterprise users can now add new accounts from the Accounts dropdown.
Fixed
- Fix missing migration for credentials.
- Fixed issue with testing connections with a non-default target name specified in the credentials.
- Fix issue where Bigquery connections could be created with invalid values for
location
.
dbt Cloud v1.0.6 (March 30, 2020)
This release adds UIs to select group permissions in the project settings UI. It also contains bugfixes for the IDE, PR build schema dropping, and adds support for dissociating Github and Slack integrations via the Admin backend.
All versions
Added
- (Enterprise only) Added ability to create group permissions for specific projects in the project settings UI.
Fixed
- Fix empty state for selecting github repositories
- Fixed an issue with the IDE failing to report an invalid project subdirectory for a dbt project
- Fix blank loading screen displayed when switching accounts while on account/profile settings page
- Fix issue preventing schemas from dropping during PR builds
- Fix issue where whitespace in user's name breaks default schema name
- Added webhook processing for when a user disassociates github access to their account.
- Added slack disassociation capability on user integrations page and on backend admin panel (for notifications).
Changed
- Declare application store using configureStore from redux-toolkit
dbt Cloud v1.0.5 (March 23, 2020)
All versions
Added
- Add support for authenticating Development and Deployment Snowflake credentials using keypair auth
- Add support for checking out tags, render git output in "clone" run step
- Add dbt 0.15.3
- Add dbt 0.16.0
Fixed
- Git provider urls now built with correct github account and repository directories.
- Invalid DateTime Start time in IDE Results Panel KPIs.
- Fix a race condition causing the Invite User UI to not work properly.
- Incorrect model build times in IDE.
Changed
- Git: ignore
logs/
andtarget/
directories in the IDE.
1.0.4 (March 16, 2020)
This release adds two new versions of dbt, adds Snowflake SSO support for Enterprise accounts, and fixes a number of bugs.
All versions
Added
- Added dbt 0.15.3rc1
- Added dbt 0.16.0rc2
- Add support for cloning private deps in the IDE when using deploy key auth.
- Log user that kicked off manual runs.
- Enterprise support for authenticating user Snowflake connections using Snowflake single sign-on
Fixed
- Fixed issue loading accounts for a user if they lack permissions for any subset of accounts they have a user license for.
- Fixed issue with showing blank page for user who is not associated with any accounts.
- Fixed issue where runs would continue to kick off on a deleted project.
- Fixed issue where accounts connected to GitHub integrations with SAML protection could not import repositories
- Improved error messages shown to the user if repos are unauthorized in a GitHub integration when importing a repo
- Fix colors of buttons in generated emails
On-Premises
Added
- Added Admin backend UIs for managing user permissions.
1.0.3 (March 1, 2020)
This release contains the building blocks for RBAC, and a number of bugfixes and upgrades.
All versions
Added
- Add support for a read replica for reading runs from the API.
- Added groups, group permissions, and user groups.
- Add email address to email verification screen.
- Add Enterprise Permissions.
- Allow account-level access to resources for groups with a permission statement of "all resources" for api backwards compatibility.
- Add dbt 0.16.0b3
Fixed
- Fix issue with loading projects after switching accounts.
- Fix broken links to connections from deployment environment settings.
- Fix a bug with inviting readonly users.
- Fix a bug where permissions were removed from Enterprise users upon login.
Changed
- Update Django version: 2.2.10
- Update Django admin panel version
- Update Social Auth version and the related Django component
- Update jobs from using account-based resource permissions to project-based resource permissions
- Update modal that shows when trials are expired; fix copy for past-due accounts in modal
- Replace formatted string logging with structured logging
- Move connection and repository settings from account settings to project settings
- Update project setup flow to be used for creating projects
- Update develop requests to have a foreign key on projects
On-Premises
Added
- Accounts created from admin backend will come with a default set of groups
Changed
- Rename "Fishtown Analytics User" to "Superuser"
dbt Cloud v1.0.2 (February 20, 2020)
This release contains a number of package upgrades, and a number of bugfixes.
All versions
Added
- Add request context data to logs
- Comprehensive logging for git subprocesses
Fixed
- Fix an issue where the "Cancel Run" button does not work
- Fix warnings regarding mutable resource model defaults for jobs and job notifications
- Fix bug where users can create multiple connection user credentials through the project setup workflow
- Update auth for requests against Github's api from using query parameters to using an Authorization header
- Remove unused threads input from deployment environments
- Fix issue that prevented user from viewing documentation and data sources
- Fix issue rendering code editor panel in the IDE when using Safari
- Fix issue with log levels that caused dbt logs to be too chatty
Changed
- Update Django version: 2.2.10
- Update Django admin panel version
- Update Social Auth version and the related Django component
- Update jobs from using account-based resource permissions to project-based resource permissions
- Update modal that shows when trials are expired; fix copy for past-due accounts in modal
- Replace formatted string logging with structured logging
- Move connection and repository settings from account settings to project settings
- Update project setup flow to be used for creating projects
Removed
None.
dbt Cloud v1.0.1 (February 4, 2020)
This release makes the IDE generally available, and adds two new versions of dbt (0.15.1, 0.15.2).
For on-premises customers, there is a new set of configurations in the configuration console:
SMTP: You can now configure dbt Cloud to send email notifications through your own SMTP server.
RSA Encryption: You can now provide your own RSA keypair for dbt Cloud to use for encryption.
These fields need to be specified for your instance of dbt Cloud to function properly.
All versions
Added
- New Team List page
- New Team User Detail page
- New Invite User page
- New dashboard for Read Only users
- New dbt version: 0.15.1
- New dbt version: 0.15.2
- Ability to rename files in IDE
- New backend service for project-based resource permissions
Fixed
- Fix an issue where the user has to repeat steps in the onboarding flow
- Fix issue where user can get stuck in the onboarding flow
- Fix bug where email notifications could be sent to deleted users
- Fix UI bug not allowing user to check "Build on pull request?" when creating a job
- Fix UI bug in header of the Edit User page
- Fix issue that did not take into account pending invites and license seats when re-sending a user invite.
- Fix an issue when processing Github webhooks with unconfigured environments
- Fix console warning presented when updating React state from unmounted component
- Fix issue where closed tabs would continue to be shown, though the content was removed correctly
- Fix issue that prevented opening an adjacent tab when a tab was closed
- Fix issue creating BigQuery connections causing the the account connections list to not load correctly.
- Fix for locked accounts that have downgraded to the developer plan at trial end
- Fix for not properly showing server error messages on the user invite page
Changed
- Deployed a number of IDE visual improvements
- Batch logs up every 5 seconds instead of every second to improve database performance
- Make
retries
profile configuration for BigQuery connections optional - Support
retries
profile configuration for BigQuery connections (new in dbt v0.15.1) - Replace Gravatar images with generic person icons in the top navbar
- Remove deprecated account subscription models
- Remove external JS dependencies
Removed
- Remove the "read only" role (this is now a "read only" license type)
- Remove the "standard" license type
- Remove "beta" tag from dbt IDE
- Remove unused frontend code (team page/create repository page and related services)
Self-Service
Fixed
- Fix for locked accounts that have downgraded to the developer plan at trial end
Added
- New Plans page
- Add a 14 day free trial
- Add the ability to provision a new repository via dbt Cloud
- New Invite Team step for project setup process for trial accounts
Changed
- The "Basic" and "Pro" plans are no longer available. The new "Developer" and "Team" plans are available.
- Prorations are now charged immediately, instead of applied to the next billing cycle.
- It is no longer possible to downgrade to a plan that does not support the current number of allocated seats.
- A "Team" plan that has been cancelled will be locked (closed) at the end of the subscription's period
On-Premises
Added
- Support custom SMTP settings
- Support Azure Blob Storage for run logs + artifacts
- Optionally disable anonymous usage tracking
dbt Cloud v0.5.0 (December 19, 2019)
This release preps dbt Cloud for the general IDE release in January. Beta IDE functionality can be turned on by checking "Develop file system" in the Accounts page in the dbt Cloud backend.
All versions
Added
- New dbt version: 0.14.2
- New dbt version: 0.14.3
- New dbt version: 0.14.4
- New dbt version: 0.15.0
- New API endpoint: v3/projects
- New API endpoint: v3/credentials
- New API endpoint: v3/environments
- New API endpoint: v3/events
- IDE: Add git workflow UI
- IDE: Add filesystem management
- IDE: Hup the server when files change
- IDE: Display server status and task history
- Added development and deployment environments and credentials
- Support
--warn-error
flag in dbt runs