Overview
There is ssh enabled On-premise MySql(MariaDB) db, we are trying to copy data to SQL server using Azure Data Factory.
- Mysql as source database(MariaDb-172.x.x.x) hosted in linux(101.x.x.x).
- We have a Virtual machine with public Ip hosted in Azure.
- Azure sql database instance as destination.
- Bitvise ssh client for port forwarding. It forwards the MySQL Ip to the localhost.
- Self-hosted Azure Integration runtime to copy on-premise data.
Bitvise tunneling
- Install Bitvise to the VM, Connect MySQL server to Bitvise. In login enter Ip, ports, and authentication of the source database.
- After authentication is completed, open new SFTP window, download the text file from remote server. In the text file, we can find the Host, port, and credentials.
- Now, we need to forward IP to the local. In C2S(client to server) section enable port forwardings. Get the destination host and port from the text file and forward it to the local(127.0.0.1).
Integration runtime
Create self-hosted integration runtime in a data factory and install the IR node at the virtual network. It performs data integration securely in a private network environment needs to install self-hosted IR on premises.
Data movement
- Use the copy data tool for data movement activities.
- Create linked services to connect source and destination. In the linked service to connect MySQL database and enter server name as localhost and enter the credentials.
- Create datasets and then finally pipeline.
