1
0
mirror of https://github.com/bitwarden/server.git synced 2025-02-02 23:41:21 +01:00
bitwarden-server/util/Migrator/DbScripts
Matt Gibson 785e788cb6
Support large organization sync (#1311)
* Increase organization max seat size from 30k to 2b (#1274)

* Increase organization max seat size from 30k to 2b

* PR review. Do not modify unless state matches expected

* Organization sync simultaneous event reporting (#1275)

* Split up azure messages according to max size

* Allow simultaneous login of organization user events

* Early resolve small event lists

* Clarify logic

Co-authored-by: Chad Scharf <3904944+cscharf@users.noreply.github.com>

* Improve readability

This comes at the cost of multiple serializations, but the
 improvement in wire-time should more than make up for this
 on message where serialization time matters

Co-authored-by: Chad Scharf <3904944+cscharf@users.noreply.github.com>

* Queue emails (#1286)

* Extract common Azure queue methods

* Do not use internal entity framework namespace

* Prefer IEnumerable to IList unless needed

All of these implementations were just using `Count == 1`,
which is easily replicated. This will be used when abstracting Azure queues

* Add model for azure queue message

* Abstract Azure queue for reuse

* Creat service to enqueue mail messages for later processing

Azure queue mail service uses Azure queues.
Blocking just blocks until all the work is done -- This is
how emailing works today

* Provide mail queue service to DI

* Queue organization invite emails for later processing

All emails can later be added to this queue

* Create Admin hosted service to process enqueued mail messages

* Prefer constructors to static generators

* Mass delete organization users (#1287)

* Add delete many to Organization Users

* Correct formatting

* Remove erroneous migration

* Clarify parameter name

* Formatting fixes

* Simplify bump account revision sproc

* Formatting fixes

* Match file names to objects

* Indicate if large import is expected

* Early pull all existing users we were planning on inviting (#1290)

* Early pull all existing users we were planning on inviting

* Improve sproc name

* Batch upsert org users (#1289)

* Add UpsertMany sprocs to OrganizationUser

* Add method to create TVPs from any object.

Uses DbOrder attribute to generate.
Sproc will fail unless TVP column order matches that of the db type

* Combine migrations

* Correct formatting

* Include sql objects in sql project

* Keep consisten parameter names

* Batch deletes for performance

* Correct formatting

* consolidate migrations

* Use batch methods in OrganizationImport

* Declare @BatchSize

* Transaction names limited to 32 chars

Drop sproc before creating it if it exists

* Update import tests

* Allow for more users in org upgrades

* Fix formatting

* Improve class hierarchy structure

* Use name tuple types

* Fix formatting

* Front load all reflection

* Format constructor

* Simplify ToTvp as class-specific extension

Co-authored-by: Chad Scharf <3904944+cscharf@users.noreply.github.com>
2021-05-17 09:43:02 -05:00
..
2017-08-19_00_InitialSetup.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-08-22_00_LicenseCheckScripts.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-08-30_00_CollectionWriteOnly.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-09-06_00_CipherDetails.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-09-08_00_OrgUserCounts.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-10-25_00_OrgUserUpdates.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-11-06_00_FamilyPlanAdjustments.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-11-13_00_IndexTuning.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-11-24_00_UpdateProcs.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2017-12-12_00_Events.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-02-28_00_LoginUris.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-03-12_00_FixLoginUris.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-03-21_00_AdminPortal.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-04-02_00_Org2fa.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-04-24_00_CipherQueryTuning.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-06-11_00_WebVaultUpdates.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-07-28_00_DbTuning.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-08-14_00_UserKdf.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-08-28_00_PremiumOrgAbilities.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-09-25_00_OrgPurge.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-10-17_00_ManagerRole.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2018-12-19_00_OrgUserTwoFactorEnabled.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2019-01-31_00_Transactions.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2019-03-01_00_OrgApi.sql move migrator project to util 2019-03-25 13:23:50 -04:00
2019-05-01_00_CipherOrgDetailsFix.sql fix issues on cipher admin endpoints 2019-05-01 09:38:13 -04:00
2019-05-15_00_GroupNameFixes.sql group name fix 2019-05-15 22:38:52 -04:00
2019-05-28_00_CollectionCipherImprovements.sql collection cipher query improvements 2019-05-28 23:55:47 -04:00
2020-02-18_00_PolicySetup.sql Enforce 2fa policy (#654) 2020-02-19 14:56:16 -05:00
2020-03-26_00_CipherSoftDelete.sql Updated PR comments, changed smart defaults for behavior, updated Cipher table index 2020-03-27 10:23:37 -04:00
2020-04-01_00_CipherSoftDelete.sql [Soft-Delete] Simplify the data-tier, removed extra sprocs and reuse update 2020-04-01 16:39:27 -04:00
2020-04-02_00_CipherSoftDelete.sql [Soft Delete] - cleanup whitespace in Cipher_Restore 2020-04-10 10:51:27 -04:00
2020-04-09_00_CipherSoftDelete.sql [Soft Delete] - Add not null/is null filters to soft delete and restore sprocs 2020-04-09 15:25:17 -04:00
2020-05-02_00_SprocPerfTweaks.sql Sproc tweaks (#730) 2020-05-21 11:35:00 -04:00
2020-05-22_00_HiddenPassword.sql add missing [ViewPassword] true (#799) 2020-06-27 15:09:04 -04:00
2020-06-23_00_OrgIdentifier.sql DAL & CRUD for SSO 2020-06-25 16:42:29 -04:00
2020-06-24_00_SsoConfig.sql Remove Id from SsoConfig_Create sproc 2020-06-26 16:47:41 -04:00
2020-06-25_00_ReferenceId.sql DAL & CRUD for SSO 2020-06-25 16:42:29 -04:00
2020-07-17_00_ReferenceData.sql Transition reference id to data (#828) 2020-07-20 15:19:46 -04:00
2020-07-20_00_OrgSso.sql Added UseSso bool to Organization (#834) 2020-07-22 09:38:39 -04:00
2020-07-21_00_BulkDeleteCiphersAsOrgAdmin.sql missing go 2020-07-28 21:53:12 -04:00
2020-07-27_00_SsoUser.sql Sso user table, model and repo stubbed out (#837) 2020-07-28 10:03:09 -04:00
2020-07-28_00_SsoBound.sql return if org user has sso binding (#839) 2020-07-28 21:11:45 -04:00
2020-07-30_00_IdServerv4.sql upgrade identity server 4 to v4 (#842) 2020-07-30 17:00:13 -04:00
2020-08-12_00_OrgIdentifierProc.sql Added PreValidate endpoint on Account controller (#896) 2020-08-28 12:14:23 -04:00
2020-08-13_00_AllowNullMasterPassword.sql allow user registration for sso (#865) 2020-08-13 17:30:10 -04:00
2020-08-19_00_AddIdentifierToOrgView.sql Create sso user api (#886) 2020-08-26 14:12:04 -04:00
2020-08-19_00_SsoConfigGetAll.sql Added get for sso config repo by revision date (#878) 2020-08-19 13:35:17 -04:00
2020-08-28_00_OrgByIdentifierFix.sql Added PreValidate endpoint on Account controller (#896) 2020-08-28 12:14:23 -04:00
2020-09-01_00_DeleteSsoUser.sql delete sso user when deleting org user (#901) 2020-09-01 15:07:47 -04:00
2020-09-01_01_DeleteSsoUser2.sql delete ssouser on org and user delete (#902) 2020-09-01 16:05:37 -04:00
2020-09-02_00_DeleteSsoConfig.sql delete sso config when deleting org (#904) 2020-09-02 10:48:15 -04:00
2020-09-09_00-ScriptMigrateU2FToWebAuthn.cs WebAuthn (#903) 2021-03-22 23:21:43 +01:00
2020-10-06_00_Send.sql Send APIs (#979) 2020-11-02 15:55:49 -05:00
2020-10-08_00_DeleteOrgUserWithOrg.sql [Require SSO] Enterprise policy enforcement (#970) 2020-10-26 11:56:16 -05:00
2020-10-14_00_OrgUserReadByUserIds.sql Only org policy (#962) 2020-10-20 02:48:10 -04:00
2020-10-20_00_OrgReadAbilities.sql [Require SSO] Enterprise policy enforcement (#970) 2020-10-26 11:56:16 -05:00
2020-10-28_00_UserApiKey.sql Implement User-based API Keys (#981) 2020-11-10 15:15:29 -05:00
2020-11-16_00_SalesTax.sql fixed a copy/paste bug in the tax rate migration script (#1077) 2021-01-07 16:36:18 -05:00
2020-11-18_00_EmergencyAccess.sql Add support for Emergency Access (#1000) 2020-12-16 14:36:47 -05:00
2020-12-04_00_OrgUserReadByOrgEmail.sql Fix sproc name mismatch in migration sql (#1066) 2020-12-30 16:21:14 -05:00
2020-12-06_00_OrgUserOrgDetailsReadByUserIdStatusOrgId.sql [Policy] Personal Ownership (#1013) 2020-12-11 10:45:26 -06:00
2020-12-14_00_Permissions.sql Implemented Custom role and permissions (#1057) 2021-01-12 11:02:39 -05:00
2021-01-05_00_ReturnRevisionDateOnCipherRestore.sql Add cipher response to restore (#1072) 2021-01-08 08:52:42 -06:00
2021-01-28_00_AddDeleteSendsToUserDeleteById.sql Delete sends belonging to user on user delete (#1116) 2021-02-05 12:37:55 -06:00
2021-02-26_00_EmergencyAccess_ReadToNotify.sql [Bug] Updated incorrect formatting/spelling on migrator script (#1228) 2021-03-22 10:24:28 -05:00
2021-03-04_00_Installation_Enlarge_Email_Column.sql Fixes #1101: Extend email column length to 256 characters (MSSQL) (#1191) 2021-03-18 16:43:49 -04:00
2021-03-04_01_User_Enlarge_Email_Column.sql Fixes #1101: Extend email column length to 256 characters (MSSQL) (#1191) 2021-03-18 16:43:49 -04:00
2021-03-04_02_Organization_Enlarge_Email_Column.sql Fixes #1101: Extend email column length to 256 characters (MSSQL) (#1191) 2021-03-18 16:43:49 -04:00
2021-03-04_03_OrganizationUser_Enlarge_Email_Column.sql Fix column NULLness for OrganizationUser table (#1239) 2021-03-24 12:50:57 -04:00
2021-03-04_04_EmergencyAccess_Enlarge_Email_Column.sql Fix emergency access migration not working (#1244) 2021-03-29 17:28:36 +02:00
2021-03-22_00_Send_Add_HideEmail_Column.sql Hide email address in Sends (#1234) 2021-03-29 07:56:56 +10:00
2021-03-23_00_AddResetPasswordKey.sql [Reset Password] Update all existing tables/sprocs/migrator scripts (#1235) 2021-03-23 16:04:11 -05:00
2021-03-26_00_CipherDeletedIndex.sql job to delete trashed ciphers nightly (#1243) 2021-04-02 11:14:21 -04:00
2021-04-07_00_IncreaseOrgSeatSize.sql Support large organization sync (#1311) 2021-05-17 09:43:02 -05:00
2021-04-16_00_OrganizationUser_DeleteMany.sql Support large organization sync (#1311) 2021-05-17 09:43:02 -05:00
2021-04-27_00_OrganizationUser_UpsertMany.sql Support large organization sync (#1311) 2021-05-17 09:43:02 -05:00
2021-04-28_00_OrgResetPasswordAbilityAndRsaKeys.sql [Reset Password] Organization Key Pair (#1292) 2021-05-06 14:53:12 -05:00
2021-04-30_00_Select_Known_OrganizationUsers_Emails.sql Support large organization sync (#1311) 2021-05-17 09:43:02 -05:00
2021-05-04_00_CipherPasswordPromptFixed.sql Fix password re-prompt not working in org view (#1296) 2021-05-04 20:36:35 +02:00
2021-05-11_00_BulkReinvite.sql Bulk re-invite of org users (#1316) 2021-05-12 11:18:25 +02:00