GCP Data Engineer (senior profiles)

[sam k]

Position:GCP Data Engineer

Location: Nashville,TN (Onsite)

Senior Data Engineer With GCP experience.

Skillset Required.

Project is for Migration of SQL Server on Prem to PostgreSQL on GCP.
.. SQL Server
... Stored Procedure, 
... SSIS
... SSRS

.. PostgreSQL
... Stored procedure

.. GCP Data services
PostgreSQL on GCP 

 

Job Description

Need to Know:

• SQL Server 
• Intermediate level,
• Knowledge required: Tables, views, stored procedure, user functions)
• Why: Need to understand the source structure to be able to check in the target if the respective structure was created and the data was correct ingested
• SSIS
• Junior leve (basic understanding is enough)
• Knowledge required: now how to use, open the packages and identify the stored procedures, database connections, and other dependencies. 
• Why: to help Shannon map, design the new solution with cloud run jobs
• PostgreSQL 
• intermediate level.
• Knowledge required: tables, views, stored procedure, user functions
• Why: the client is using a tool called ISPIRER (MsSQL to PostgreSQL Migration Tool by Ispirer, Free Trial), the tool was suppose to migrate all objects from SQL Server to PostgreSQL. However, all item that face erros during the migration process will need to be done manually. Based on my tests until now this tool migrate tables and data perfectly but face some issues with stored procedures, views, user functions). At least 80% fof the job is done by the tool
• Google Platform
• Basic to intermediate level
• Knowledge required: knows how to use the platform, find the services like cloud run, database instances etc.
• Why: the migration is to GCP platform.
• Database management tools
• Intermediate level
• Knowledge required: know how to use PGAdmin, Dbeaver or any other tool to connect to the database and make any validation required

Nice to have

• ISpirer
• Why: tool used by the client to migrate databases from onprem to cloud (will be used in other projects as well)
• Programming like go/python
• Why: help Shannon if needed in the SSIS packages recreation
• GCP Big Query

Why: the client is moving into the direction to have bigquery as the source of true. I believe this project will have a phase 2 and this knowledge will be important