The Data Architect will play a pivotal role in designing, implementing, and maintaining the data infrastructure for a complex Big Data Platform. This individual will be responsible for ensuring data quality, integrity, and security while optimizing data storage, processing, and retrieval.
Key Responsibilities
- Data Architecture Design: Develop and maintain a comprehensive data architecture that aligns with business objectives and supports the scalability and performance of the Big Data Platform.
- Data Modeling: Create data models that accurately represent the structure and relationships of data entities, ensuring data consistency and integrity.
- Data Integration: Design and implement data integration strategies to ingest data from diverse sources into the Big Data Platform, addressing data quality and transformation requirements.
- Data Quality: Establish data quality standards and implement processes to ensure data accuracy, completeness, and consistency throughout the data lifecycle.
- Data Governance: Develop and enforce data governance policies and procedures to protect sensitive data and maintain data integrity.
- Performance Optimization: Monitor and optimize the performance of the Big Data Platform, identifying bottlenecks and implementing improvements to enhance data processing efficiency.
- Technology Selection: Evaluate and select appropriate data technologies and tools based on business needs and technical requirements.
- Collaboration: Work closely with data engineers, data scientists, and other stakeholders to ensure effective communication and coordination.
Required Technical Skills:
- Big Data Technologies: Proficiency in Hadoop, Spark, Kafka, or other relevant Big Data frameworks.Experience with Airflow is a must.
- Data Warehousing and Data Marts: Experience with data warehousing concepts, ETL processes, and data mart implementation.
- Database Technologies: Strong understanding of relational databases PostgreSQL, NoSQL databases, Relational Databases.
- Data Modeling: Proficiency in data modeling techniques, including ER diagrams and dimensional modeling.
- Data Quality Tools: Familiarity with data quality assessment and profiling tools.
- Programming Languages: Knowledge of Python, SQL, or other programming languages relevant to data processing and analysis.
- Cloud Platforms: Experience with cloud platforms (e.g., AWS, Azure) and cloud-based data services
Top Skills
What We Do
OSI Digital, Inc., (formerly OSI Consulting, Inc.) provides purpose-built business and technology solutions that optimize performance to enable data-driven outcomes for our customers. OSI accelerates digital transformation by offering integrated solutions that capture, secure, integrate, analyze and optimize data. Our services include the design, development, and implementation of new solutions as well as the ongoing management, enhancement and support of our customers’ existing business systems.
OSI Digital was founded in 1993, in California and has since expanded to a team of over 1,400 employees worldwide. We have offices in the US, Canada, India, Philippines, Dubai and Australia. Our main offshore delivery center of excellence is located at our state-of-the-art campus in Hyderabad, India, with additional locations in Chennai, Delhi and Bangalore. For over 25 years, we have supported a diverse portfolio of customers across various industries, including: Software & Business Services, Financial Services, Life Sciences & Healthcare, Manufacturing, Energy, Retail and Agriculture.
Our client base ranges from start-ups to Fortune 500 corporations, including: Exelon, GE, Hyundai, Toyota, Gilead, Allergan, Yamaha, Gap and Skechers. OSI Digital has developed strong partner alliances with the world’s leading technology providers such as Tableau, Salesforce, Oracle, Microsoft, GE, Amazon Web Services, Dell Boomi and Red Hat.
