Lead Data Engineer at S&P Global Market Intelligence

Job Responsibilities

You should be able to demonstrate that you have an outstanding knowledge and hands-on experience in the below areas:

• Assume technological and administrative responsibilities for a focused team
• Provide (thought) leadership in technology direction, technical services, vendor partnership, and industry standards adoption.
• Are “biased to action” and not easily blocked by problems and difficulties, instead taking ownership
• Believe in monitoring, QA, and security as a first-class citizen in any data product.
• Able to understand requirements in context to design solutions, rather than take them at face value.
• Excited to design data platforms and tools that abstract implementation details for developers, analysts, and data scientists, enabling data transit and storage “as a service.”
• Dedicated to automation, documentation, and collaboration at all stages of the engineering workflow.
• Sensitive to the balance of performance and cost with the ability to communicate and optimize for the requirements of each.
• Passionate about mentoring colleagues and educating the organization on data engineering best practices.
• Maintain an excellent understanding of the business long term goals and strategy and ensure that designs are aligned with these - able to see the forest through the trees.

What We're Looking For

• Degree in Computer Science, related field, or equivalent experience.
• Eight (8) or more years of increasing responsibility in technical data roles, with 3 or more years of experience as a data engineer lead.
• Expertise in various big data technologies both open source and cloud native, (Kafka/Kinesis, Spark/EMR, Snowflake, Presto/Athena, Airflow, Hive, Drill, Databricks).
• Expertise in data model design with sensitivity to usage patterns and goals – schema, scalability, immutability, idempotency, etc.
• Mastery of at least two of the following languages – Scala, Python, Java, Go.
• Expertise in the suite of NoSQL models and frameworks.
• Track record of choosing the right transit, storage, and analytical technology to simplify and optimize user experience.
• Real-world experience developing highly scalable solutions using micro-service architecture designed to democratize data to everyone in the organization.
• Able to function autonomously and successfully in ambiguous situations.
• Preferred experience with cloud based systems