Design and implement web crawler programs, enhance data processing quality, optimize multi-platform information extraction, manage operational stability, and address data requirements.
Summary Generated by Built In
At Cision, we believe in empowering every individual to make an impact. Here, your voice is heard, your ideas are valued, and your unique perspective fuels our collective success. As part of our global team, you'll thrive in an environment that champions curiosity, collaboration, and innovation, all while making meaningful contributions to the brands we accelerate.
Join us in shaping the future of communication and building authentic connections that matter. Whether you're solving complex problems or driving bold innovations, your growth is our success, and together, we’ll create the conversations of tomorrow.
Empower your impact at Cision. Be seen, be understood, be you.
爬虫Python开发工程师
工作职责：
1、设计和实现高效稳定的爬虫程序，收集海量数据并进行处理和分析。
2、负责多平台信息抽取、数据清洗、入库、服务化等研发和优化工作。
3、解决实际开发过程中碰到的各类数据需求和接口问题。
4、参与业务需求讨论，负责业务需求到技术实现的方案落地与实施。
5、监控爬虫运行状态，日常处理数据抓取的稳定性和准确性问题。
任职要求
1、负责设计、开发和维护高效、稳定的爬虫系统，提升数据采集的效率和质量。
2、负责多平台信息抽取、数据清洗、入库、服务化等研发和优化工作。
3、熟悉各种爬虫框架和工具。
4、熟练掌握 Python、java语言编程。
5、熟悉Linux基础命令。
6、熟练使用主流开源框架及工具，如SpringBoot、SpringCloud、Maven、Redis、MyBatis等。
7、熟悉分布式系统的设计和应用，熟悉分布式、缓存、消息等机制。
8、有较大数据规模处理的实践经验者优先。
Job Responsibilities:
1. Design and implement efficient and stable web crawler programs to collect, process, and analyze large volumes of data.
2. Responsible for the research and development and optimization of multi-platform information extraction, data cleaning, database storage, and service deployment.
3. Resolve various data requirements and interface issues encountered during the actual development process.
4. Participate in business requirement discussions and oversee the implementation of solutions from business requirements to technical execution.
5. Monitor the operational status of crawlers and handle daily issues related to data scraping stability and accuracy.
Qualifications:
1. Responsible for designing, developing, and maintaining efficient and stable crawling systems to enhance data collection efficiency and quality.
2. Responsible for the research and development and optimization of multi-platform information extraction, data cleaning, database storage, and service deployment.
3. Familiar with various web crawling frameworks and tools.
4. Proficient in programming with Python and Java.
5. Familiar with basic Linux commands.
6. Skilled in using mainstream open-source frameworks and tools, such as SpringBoot, SpringCloud, Maven, Redis, MyBatis, etc.
7. Familiar with the design and application of distributed systems, as well as mechanisms related to distributed computing, caching, and messaging.
8. Practical experience in handling large-scale data processing is preferred.
