{"product_id":"data-engineering-design-patterns-9781098165819","title":"Data Engineering Design Patterns","description":"\u003cp\u003eData projects are an intrinsic part of an organization's technical ecosystem, but data engineers in many companies continue to work on problems that others have already solved. This hands-on guide shows you how to provide valuable data by focusing on various aspects of data engineering, including data ingestion, data quality, idempotency, and more.\n\u003c\/p\u003e\u003cp\u003eAuthor Bartosz Konieczny guides you through the process of building reliable end-to-end data engineering projects, from data ingestion to data observability, focusing on data engineering design patterns that solve common business problems in a secure and storage-optimized manner. Each pattern includes a user-facing description of the problem, solutions, and consequences that place the pattern into the context of real-life scenarios.\n\u003c\/p\u003e\u003cp\u003eThroughout this journey, you'll use open source data tools and public cloud services to apply each pattern. You'll learn:\u003c\/p\u003e\u003cul\u003e\n\u003cli\u003eChallenges data engineers face and their impact on data systems\n\u003c\/li\u003e\n\u003cli\u003eHow these challenges relate to data system components\n\u003c\/li\u003e\n\u003cli\u003eUseful applications of data engineering patterns\n\u003c\/li\u003e\n\u003cli\u003eHow to identify and fix issues with your current data components\n\u003c\/li\u003e\n\u003cli\u003eTechnology-agnostic solutions to new and existing data projects, with open source implementation examples\n\u003c\/li\u003e\n\u003c\/ul\u003e\n\u003cp\u003eBartosz Konieczny is a freelance data engineer who's been coding since 2010. He's held various senior hands-on positions that allowed him to work on many data engineering problems in batch and stream processing.\u003c\/p\u003e","brand":"Bartosz Konieczny","offers":[{"title":"Default Title","offer_id":43355993899126,"sku":"9781098165819","price":79.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0671\/1374\/6550\/files\/CoreSourceHub_f9b57ddc-5b6b-481e-9da1-fe4ec8989919.jpg?v=1777472127","url":"https:\/\/ingramacademic.com\/products\/data-engineering-design-patterns-9781098165819","provider":"Ingram Academic \u0026 Professional","version":"1.0","type":"link"}