Cloud Data Infrastructure Engineer
Company Overview:
The people of Memorial Sloan Kettering Cancer Center (MSK) are united by a singular mission: ending cancer for life. Our specialized care teams provide personalized, compassionate, expert care to patients of all ages. Informed by basic research done at our Sloan Kettering Institute, scientists across MSK collaborate to conduct innovative translational and clinical research that is driving a revolution in our understanding of cancer as a disease and improving the ability to prevent, diagnose, and treat it. MSK is dedicated to training the next of scientists and clinicians, who go on to pursue our mission at MSK and around the globe.
Please review important announcements about vaccination requirements and our upcoming EHR implementation by clicking .
Important Note for MSK Employees:
Your Career Hub profile is submitted to the hiring team as your internal resume. Please be sure your profile is fully complete with your skills, relevant experience and education (if required). Click to learn more. Please note, this link is only accessible for MSK employees.
Job Description:
Cloud Data Infrastructure Engineer
Exciting Opportunity at MSK
Seeking experienced data infrastructure engineer to help drive MSK’s data modernization journey. You will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem that will be used for multiple purposes including data science and analytics.
Position Overview:
Collaborate with technical product management and operations, to deliver the engineering roadmap following the agile model.
Develop templates, playbooks, and automation to make infrastructure support and operations scalable.
Build the cloud data platform using infrastructure as code (IAC).
Develop CI/CD pipelines for both Terraform and data ingestion and transformation pipelines.
Analyze and optimize data processes for efficiency, reliability, cost effectiveness, redundancy, and security.
Help assess capabilities and integration feasibility of new technologies that are candidates for the ecosystem.
Mentor team members on best practices for implementation, deployment, and operations for cloud data pipelines.
Partner with Information Security teams to engineer secure data services on cloud platforms.
Partner with enterprise cloud platform teams to engineer service implementations that comply with cloud governance standards.
Key Qualifications:
Minimum 4+ years of Cloud Data Engineer working experience.
Proficiency in translating designs into fully developed and well-structured Terraform code for managing Databricks and AWS resources.
Proficiency with large scale data processing using PySpark including development and troubleshooting of PySpark pipelines.
Proficiency with SQL and database design.
Experience with GitOps and DataOps (preferably on GitHub)
Solid understanding of cloud networking concepts, subnets, routing, load balancing, firewalls, and cloud security.
Implementation expertise on AWS technologies including Cloud Formation, IAM, S3, EC2, Glue, MWAA.
Experience in enterprise-scale environments, building highly available IaaS and PaaS solutions.
Experience in shell scripting i.e., Bash
Experience in Cloud logging, monitoring, and observability tools such as AWS CloudWatch, Datadog
Core Skills:
An in-depth understanding of both business and technical discussions.
Excellent communication and collaboration skills.
Strong analytical, problem solving and organizational skills.
Additional Information:
Location: 633 Third Avenue, NY
Reporting to Director, Data Management
Schedule: Hybrid, 4 days a month onsite
Pay Range: $118,800 - $196,200
Helpful Links:
#LI-POST
#LI-HYBRID
Closing:
MSK is an equal opportunity and affirmative action employer committed to and in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration without regard to race, , , or expression, , , , , creed, disability, veteran status or any other factor which cannot lawfully be used as a basis for an employment decision.
Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign interpreter, or using specialized equipment.