Web Scraping Engineer (Python, Data)
Systems Plus
About the role
About Systems Plus, Inc.
At Systems Plus, we pride ourselves on being a family-oriented company that genuinely cares about our employees and their growth. With over two decades of experience in providing Global Enterprise Management, Technology, Engineering, and Professional services across the Defense and Federal sectors, we hold numerous contracts worldwide. Our commitment to your success is reflected in our competitive benefits packages, salary offerings, bonus programs, and abundant opportunities for professional development. Based in Arlington, VA, with the flexibility for telework in the Metro DC area, we invite you to become a part of our innovative team and experience the difference at Systems Plus.
Role Overview
At Systems Plus, Inc. we are looking for a Data engineer!
Tech Stack:
- AI
- Cloud
- CSS
- JSON
- Java
- JavaScript
- Machine Learning
- Python
- SQL
- Selenium
- Web
- XML
- Data
Responsibilities:
- Support the development and maintenance of the web scraping infrastructure for the agency
- Extract data from various websites and APIs, ensuring accuracy and quality
- Develop and enhance web scraping scripts and tools for data extraction
- Collaborate with cross-functional teams to determine data requirements and implement scraping solutions
- Monitor and troubleshoot scraping processes to maintain data quality and accuracy
- Optimize scraping scripts for enhanced performance and efficiency, focusing on speed, scalability, and resource use
- Stay current with the latest web scraping techniques, tools, and industry best practices
- Perform data analysis and validation to maintain the integrity of scraped data
- Work together with data engineering and data science teams to integrate scraped data into existing data pipelines
- Document and communicate technical solutions, processes, and best practices to team members
Requirements:
- Minimum of 3 years of professional experience in web scraping or a related field
- Bachelors degree in Computer Science, Information Sciences, or a related IT discipline OR additional 10 years of relevant professional experience in lieu of degree
- Proficiency in Python and Java; experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium
- Knowledge of AI/machine learning techniques for data extraction and classification
- Understanding of HTML, CSS, and JavaScript for navigating and interacting with websites
- Experience working with APIs and managing various data formats (JSON, XML, etc.)
- Familiarity with database systems and SQL for data storage and retrieval
- Knowledge of data cleaning and preprocessing techniques to ensure data integrity
- Strong problem-solving skills with an ability to troubleshoot and debug scraping issues
- Excellent communication and collaboration skills for effective teamwork
- Attention to detail with the capability to manage large volumes of data efficiently
- Preferred experience with cloud platforms for scalable web scraping infrastructure
- Familiarity with data visualization tools and techniques
- Understanding of legal and ethical considerations related to web scraping
- Security clearance: Secret
Benefits & Perks:
- Bonus programs
- Professional development opportunities
Skills
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free