Req ID: 307085
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Data Engineer Tester to join our team in Bangalore, Karnātaka (IN-KA), India (IN).
Primary Responsibility as Data Engineer
1) Build and implement PySpark-based data pipelines in Azure Synapse to transform and load data into ADLS in Delta format
2) Design and implement dimensional (star/snowflake) and 3NF data models. Optimized for access using Power BI
3) Perform unit testing of data pipelines and its transformations
4) Design and build metadata driven data pipelines using Pyspark in Azure Synapse
5) Analyze and optimize Spark SQL queries
6) Optimize integration of data lake with Power BI semantic model
7) Collaborate with cross-functional teams (data architects, engineers, and POs) to ensure data models align with business needs
8) Perform STM(source to target mapping) from source to multiple layers in the data lake
9) Maintain version control and CI/CD pipelines in Git and Azure DevOps
10) Integrate Azure Purview to enable access controls. Additionally implement row level security
Primary Responsibility as Tester
1) Build and implement automated test validation frameworks using PySpark to validate data pipelines.
2) Develop and execute test cases to verify data transformations from source to taget in data lake
3) Develop and execute performance tests on Spark SQL queries
4) Test access controls and row level security
3+ Years of experience in :
• Hands-on experience with Azure Synapse, ADLS, Delta format, and metadata-driven data pipelines
• Experienced in implementing dimensional (star/snowflake) and 3NF data models
•Experienced in PySpark and Spark SQL, including query optimization and performance tuning
• Experienced in writing complex SQL including windowing functions
• Experienced in performing Source-to-Target Mapping (STM) by analyzing source systems and defining transformation logic
• Strong problem-solving and analytical skills for debugging and optimizing data pipelines in Azure Synapse
• Familiarity with CI/CD practices in Git and Azure DevOps
• Working experience in Azure DevOps-based development environment
About NTT DATA
NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com
NTT DATA endeavors to make accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here . If you'd like more information on your EEO rights under the law, please click here . For Pay Transparency information, please click here .
...bring to our purpose-minded team. All while understanding that together we are even better. Schedule: Full Time Weekend Nights (weekend night shift differentials included!) Shift :7pm-7am. Saturday and Sunday at Lake Mary ED, Monday at Oviedo ED The...
...Multiple positions - CarolinaPower/MetroPower is seeking electrician apprentices with a strong work ethic and drive to be the best in the industry... ...Office covers the Central South Carolina area. No experience required, however, should possess hand tools and a pair of...
...storage solutions, climate-controlled structures, and industrial enclosures that serve various industries, including logistics, manufacturing, energy, and disaster recovery. With a strong reputation for engineering excellence, safety, and adaptability, the company has been...
...provides comprehensive medical, behavioral, rehabilitative, and educational services for children and adolescents ages 2 through 22 who... ...Qualifications Job Requirements: Bachelor's Degree in Special Education (Required as min) or Master's Degree in Special Education...
...store and in the community Requirements: High school diploma or equivalent Previous retail experience preferred Ability to work in a fast-paced environment Strong communication and interpersonal skills Genuine passion for retail and fashion Flexible...