CareFirst Careers

Lead Big Data Engineer (Real Time Streaming Expert)

This job posting is no longer active

Resp & Qualifications

PRINCIPAL ACCOUNTABILITIES:   The incumbent’s accountabilities include, but are not limited to, the following:               

System Design and Implementation:  Designs and Builds Big Data solutions to meet business requirements.  Assumes complete ownership of Delivery from Data Engineering stand point in given project(s)

Leadership:  Assists other Developers in resolving complex issues. Performs code reviews and ensures that standards are followed consistently across projects   

Procedural: Creates and maintains Coding standards, Design Documents, Production Run books

Research and Development: Recommends and implements new technologies to benefit the business.   


Required:  This position requires a BA/BS in Computer Science, Information Systems, Information Technology or related field with 10+ years of prior experience in software development, Data Engineering and Business Intelligence OR equivalent experience.  Candidate must have work authorization without needing any sponsorship.

  • Proven experience Design, building and optimizing data pipelines to ingest/process structured and unstructured datasets
  • Advanced Level experience (7+ years ) with Java , Python/Scala programming languages
  • Advanced level Experience (3+ years ) building Real Time streaming solutions, leveraging  Flume, Kafka and Apache Spark streaming
  •  2+ years in Hadoop technogies such as MapReduce, Hive, Sqoop, Oozie, Impala and other related Big Data technologies
  • Experience tuning various configuration parameters ( Hive/Spark etc) for optimal performance
  • Advanced level experience with at least one NoSQL stores (Hbase, Cassandra, MongoDB etc) ; Hbase is highly preferred
  • Prior experience leading  Big Data projects with a minimum team size of 4 developers
  • Strong communication skills and self-starter mentality and the ability to think outside the box.



  • Healthcare experience
  • Experience in WebService/API integration, providing Data as a Service
  • Cloudera Certified Hadoop and Spark Developer (CCA175)



Department: Big Data

Equal Employment Opportunity

CareFirst BlueCross BlueShield is an Equal Opportunity (EEO) employer.  It is the policy of the Company to provide equal employment opportunities to all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information.

Hire Range Disclaimer

Actual salary will be based on relevant job experience and work history.

Where To Apply

Please visit our website to apply:

Closing Date

Federal Disc/Physical Demand

Note:  The incumbent is required to immediately disclose any debarment, exclusion, or other event that makes him/her ineligible to perform work directly or indirectly on Federal health care programs.


The physical demands described here are representative of those that must be met by an employee to perform the essential duties and responsibilities of the position successfully.  Requirements may be modified to accommodate individuals with disabilities.


The employee is primarily seated while performing the duties of the position.  Occasional walking or standing is required.  The hands are regularly used to write, type, key and handle or feel small controls and objects.  The employee must frequently talk and hear.

Sponsorship in US

Must be eligible to work in the U.S. without Sponsorship

Learn more about Information Technology