AWS Database Migration Service and Snowball

If you want to move database on primes to cloud you can use this service.

• Quickly and securely migrate databases to AWS resilient, self healing
• Source DB remains available during the migration
• Homogeneous migration for example mysql to mysql
• Heterogeneous migration for example mysql to Aurora
• Continuous Data replication using CDC
• You must create an EC2 instance to perform the replication tasks

Source DB > EC2 instance running DMS > Target DB

DMS Sources and Targets

Sources:

• On-Primes and EC2 instances db; Oracle, MSsql, MySQL, MariaDB, Postgresql, SAP, DB2
• Azure: Azure SQL DB
• Amazon RDS: all including Aurora
• Amazon S3

Targets:

• On-Primes and EC2 instances db; Oracle, MSsql, MySQL, MariaDB, Postgresql, SAP
• Amazon RDS
• Amazon Redshift
• Amazon DynamoDB
• Amazon S3
• ES
• Kinesis Data Streams
• DocumentDB

How is it work?

AWS Schema Conversion Tool! Convert your DB’s schema from one engine to another for example Oracle to MySQL it’s OLTP. If Teradata to AWS redshift it’s OLAP.

You can use AWS SCT to create AWS DMS endpoints and tasks.

Direct Connect

• Provides a dedicated private connection from a remote network to your VPC (Virtual Private Cloud)
• 1Gbps or 10Gbps dedicated network connection
• Support IPv4 and IPv6

If you want to a direct connect to one or more VPC in many diffrent region( same account) you must use a direct connect gateway.

Snowball

Physical data transport solution that helps moving TBs or PBs of data in or out of AWS. Alternative to moving data over the network. Secure tamper resistant uses 256 bit encryption. Tracking uses SNS. Pay per data tranfer job.

Use case: Large data cloud migration. If it takes more than a week to transfer over the network u should be use snowball devices!

Snowball processing

• Request snowball devices from AWS console for delivery
• Install the snowball client on your servers
• Connect the snowball to your servers and copy files using client
• Ship back the device when you’re done
• Data will be loaded into S3 bucket
• Snowball is completely wiped
• Tracking is done using SNS

Snowball Diagram

Direct upload to S3:

• client > 10Gbit/s >S3

With snowball:

• Client~Aws snowball > ship > Aws snowball → import/export >S3

Snowball Edge

• Snowball edges add computational capability to the device
• 100 TB capacity
• 24 vCPU
• Compute optimized 52 vCPU and optional GPU
• Support Lambda

Very useful to pre processing the while data moving and you can use for data migration, image collation, IoT capture, ML.

Snowmobile

It’s turck! not joking! Transfer exabytes of data. Each snowmobile has 100pb of capacity. I guess it’s not our business but know it anyway.