Job Description:
Position: Senior Data Engineer
Location: Barcelona, New York, New Jersey, London
Department: Technology
About the Role
Dow Jones is seeking an experienced Data Engineer to join our AI Engineering Team. You will be responsible for designing, developing, and maintaining robust data pipelines for data scraping, processing, extraction, transformation, loading, and storage. You will collaborate within our team to ensure the efficient and reliable retrieval of data, enabling seamless integration with downstream systems for analysis and decision-making.
As a key team member, you will play a crucial role in operationalizing data solutions to meet our organization's needs and deliver tangible value. You will leverage your strong data engineering skills to develop robust, secure, and scalable data pipelines, utilizing your expertise in data retrieval and processing techniques.
Responsibilities:
-
Collaborate with data scientists and ML engineers to design, develop, and maintain end-to-end data pipelines for extraction, transformation, loading (ETL), and storage.
-
Clean, transform, and structure data using industry-standard techniques, ensuring quality and consistency.
-
Work with APIs to retrieve data from external sources or integrate with third-party services, adhering to best practices.
-
Manage and optimize SQL and NoSQL database systems for data storage, ensuring integrity and performance.
-
Automate data fetching, processing, and storage by implementing data pipelines, leveraging ETL principles.
-
Identify and troubleshoot issues related to data quality and pipeline performance, applying problem-solving skills.
-
Communicate effectively with stakeholders and data providers to gather requirements and ensure project alignment.
-
Stay updated with industry trends, emerging technologies, and best practices in data engineering and ETL processes.
Qualifications:
-
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related STEM field.
-
At least 3 years of industrial experience in a data engineering role
-
Experience with web scraping techniques and data extraction methods.
-
Solid understanding of data processing techniques, including extraction, transformation, and loading (ETL).
-
Ability to work with APIs to retrieve data from external sources or integrate with third-party services.
-
Experience with cloud-based infrastructure and services (e.g., AWS, GCP, etc.).
-
Familiarity with database systems, including SQL and NoSQL databases.
-
Familiarity with NLP and Machine Learning frameworks and libraries (e.g., PyTorch, HuggingFace, LangChain, spaCy, NLTK, scikit-learn, etc.)
-
Experience in designing and implementing end-to-end data pipelines for web content retrieval and processing.
-
Excellent problem-solving skills and attention to detail in identifying and troubleshooting issues.
-
Strong communication and collaboration skills to work effectively with team members and stakeholders.
-
Continuous learning mindset with a willingness to stay updated with industry trends and best practices.
Reasonable accommodation: Dow Jones, Making Careers Newsworthy - We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law. EEO/AA/M/F/Disabled/Vets. Dow Jones is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, email us at [email protected]. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
Business Area:
Dow Jones - Technology
Job Category:
Data Analytics/Warehousing & Business Intelligence
Union Status:
Non-Union role
Top Skills
What We Do
When you join Dow Jones, you become part of the most dynamic, creative and savvy news and information companies in the world. As a global leader in news and business intelligence, we're newswires, websites, newspapers, apps, newsletters, databases, magazines, and video --including some of the widest-read and most-respected brands, like The Wall Street Journal, Factiva, Barron’s, MarketWatch, Financial News, DJX, Dow Jones Risk & Compliance, Dow Jones Newswires, and Dow Jones VentureSource.
Our products inform the discussions and decisions that are vital to the world's commerce, while our databases make the business world more transparent. We continually develop technology to transform information into insight and prosperity. We enlighten and inspire audiences around the globe with authoritative, differentiated and trusted content.
Gallery
