Skip to main content
This feature is currently in private beta. Please reach out to us on Slack if you’re interested in trying it out

​
Overview

Your own data can only get you so far. It’s common for data pipelines to enrich first party data with third party data in order to get a more complete picture. This is usually a complicated engineering task and involves running additional infrastructure but in Vinyl enrichment is supported directly in the transform layer. Common use cases for enrichment include:
  • Zipcode to city mapping
  • IP address to location mapping
  • Email to company mapping
  • Phone number to company mapping
  • Weather enrichment
We support enrichment through managed data broker services. These services are provided by third party vendors and are integrated directly into Vinyl. You can bring your own API key. Some initial providers that we support in private beta are:

​
How to Enrich Data

Enriching data is as easy as passing in the provider to your existing model. Let’s say you have a SaaS product postgres database with users in it that you’d like to enrich with third party data from Apollo.
idnameemail
1Alex Johnson[email protected]
2Bethany Kim[email protected]
3Carlos Smith[email protected]
4Diana Cruz[email protected]
5Ethan Wong[email protected]
We can use Vinyl’s ApolloEnrichment provider to enrich the data for matching columns and transform the data.
my_project/customer_models.py
from vinyl import model
from vinyl.enrichment import ApolloEnrichment
from my_project.sources import PostgresProductUsers

@model(deps=[PostgresProductUsers, ApolloEnrichment])
def enriched_users(users, apollo):
    users.enrich(apollo, on='email', cols=['company', 'title', 'website', 'location', 'size'])
    return users
idnameemailcompanytitlewebsitelocationsize
1Alex Johnson[email protected]Tech InnovationsProduct Managertechinnovations.comNew York, NY101-500
2Bethany Kim[email protected]Global SolutionsSenior Developerglobalsolutions.bizSan Francisco, CA501-1000
3Carlos Smith[email protected]Creative MediaCreative Directorcreativemedia.coLos Angeles, CA51-100
4Diana Cruz[email protected]Health PlusHR Specialisthealthplus.orgChicago, IL1001-5000
5Ethan Wong[email protected]Eco VenturesEnvironmental Analystecoventures.netAustin, TX11-50