Sr. Data Software Engineer (Snowflake & Azure)

---

Job description

Snowflake & Azure

Position Summary:

This role actively participates as a Senior Data Engineer, contributing to Azure Data pipeline & data platform architecture, design, development, implementation, review, enhancing & creating new features within client's marketing and reporting platform, and supporting critical production issues.

Essential Functions:

• Work effectively with team and product owners to define & clarify requirements, perform detailed analysis, and develop robust & maintainable solutions meeting business requirements
• Analyze, plan, develop, deploy, and manage a large scalable distributed system.
• Design, develop, and maintain Azure data pipeline for data processing including normalization and transformation.
• Build and support Microservice and Stateless architecture
• Understand and apply the advanced principles of entity-relationship model design, good data typing practices, index management, data management, and data security.
• Write a reliable and maintainable code at each layer of the product development.
• Research and prototype new product & database features, design, and architecture ahead of mainstream development.
• Proactively initiate & contribute to system improvements and innovations.
• Provide support to troubleshoot and resolve technical & performance issues in a production environment.
• Review designs, code, and test plans of other developers and provide recommendations for improvement or optimizations
• Follow defined software development lifecycle best practices.
• Work effectively with management and members to clarify needs and priorities.
• Miscellaneous duties as assigned.

Qualifications:

• Master/Bachelor's degree in Computer Science, or STEM (Science, Technology, Engineering, Math) majors, or related experience
• 8+ years of database and software development experience, including Data platform design, development, and Microservice architecture
• 5+ years of experience in developing a relational & non-relational data platform/data pipeline using Azure cloud solutions.
• 3+ years of experience in designing, building, and supporting Azure data pipelines & messaging services.
• Expert-level knowledge of SQL, TSQL, performance tuning, Query Plans, and Query Plan optimization for TSQL.
• Advance-level knowledge of developing data pipeline using Apache Kafka
• Advance-level knowledge of developing complex Data Warehouses
• Advance-level knowledge of developing solutions using C#, and REST API.
• Advance-level knowledge of CI/CD using Azure DevOps to support Data Platform & Microservice projects
• Demonstrated experience in working with at least one scripting language such as PowerShell, Perl, Python, Ruby, etc. with the intent to automate manual tasks (monitoring, deployments, testing, etc.)
• Knowledge of SQL Server 2
• Strong technical and communication skills.
• Desire and ability to work as part of a team with minimal supervision in a results-oriented, fast-paced, dynamic environment.
• Experience in managing and developing SQL Server, BI Suite, database custom tools using SQL Server Data Tools/Visual Studio 2 IDE's.
• 3+ years' experience in Azure DevOps/GIT repository.

Preferred:

• Development experience of Snowflake Data cloud
• Database architecture and designing experience.
• Travel industry experience; or Ecommerce experience with CRM or online sales.
• PowerShell scripting knowledge.
• Advance level knowledge in automation test creation.
• Experience/Knowledge integrating new technologies (e.g., Hadoop) with traditional RDBMS
• Experience/Knowledge in the Hadoop ecosystem: Spark, Kafka, Hive, HiveQL, Map Reduce, Yarn, HDFS, etc...