Launching an Inner Knowledge Market with Atlan
The Energetic Metadata Pioneers collection options Atlan clients who’ve not too long ago accomplished a radical analysis of the Energetic Metadata Administration market. Paying ahead what you’ve discovered to the following knowledge chief is the true spirit of the Atlan neighborhood! So, they’re right here to share their hard-earned perspective on an evolving market, what makes up their trendy knowledge stack, revolutionary use circumstances for metadata, and extra.
On this installment of the collection, we meet Cristina Perez Martinez, Knowledge Engineer and Architect, and Ezequiel Barbero, Market & Enterprise Intelligence Supervisor at Telefónica Tech, who share how a contemporary knowledge cataloging expertise and column-level lineage will assist a broad imaginative and prescient for knowledge democratization.
This interview has been edited for brevity and readability.
May you inform us a bit about your self, your background, and what drew you to Knowledge & Analytics?
Ezequiel Barbero:
I’ve acquired a Masters in Huge Knowledge and have labored in Knowledge & Analytics since 2002. I began at Telefónica in Argentina with the BI Knowledge Crew engaged on ETLs based mostly in SQL. Then I labored in Knowledge Engineering serving to with Knowledge Science, working with the top of that workforce in Argentina.
In 2019, I got here to Spain to work with their Knowledge Science workforce on Advertising and marketing Intelligence, and in 2021 I joined Telefónica Tech to start out the BI Crew.
Cristina Perez Martinez:
I began working at Telefónica in 2019 as a Python developer, and I moved to Telefónica Tech in 2021. My workforce has primarily been working as Knowledge Engineers and Knowledge Architects for the BI workforce.
Would you thoughts describing Telefónica, and the way your knowledge workforce helps the group?
Cristina:
Telefónica is split into fairly just a few totally different firms, however as a complete, it’s a Telecommunications Enterprise. Right here, in Telefónica Tech, the digital enterprise unit, we’ve been centered on digital applied sciences resembling AI & BD, connectivity and IoT, Cybersecurity, Cloud, and Blockchain.
Our workforce is split into two, with a part of the workforce centered on structure and engineering, getting uncooked knowledge, then standardizing and reworking it till it goes into Snowflake, our Knowledge Warehouse. The remainder of the workforce is targeted on Knowledge Evaluation, based mostly in Snowflake and coding in SQL. From there, they develop dashboards in PowerBI.
Ezequiel:
Telefónica Tech has a workforce engaged on IoT and Huge Knowledge for exterior use circumstances, however our workforce is accountable for inner use circumstances, supporting the corporate. We assist infrastructure, transformation, and for nearly a 12 months now, Knowledge Governance.
What does your knowledge stack seem like?
Ezequiel:
Our stack is predicated on Microsoft Azure, and we use Knowledge Manufacturing unit for Orchestration. We use Databricks’ ETL software, blob storage, and knowledge lake. Snowflake is Telefónica’s knowledge warehouse.
Why seek for an Energetic Metadata Administration resolution? What was lacking?
Ezequiel:
Our firm has over 6,200 folks, however our workforce is small relative to all the group. So if it’s vital to enhance knowledge democratization, then that wouldn’t be doable with out self-service, and with out Knowledge Governance.
Why was Atlan a superb match? Did something stand out throughout your analysis course of?
Ezequiel:
We had been first searching for a cloud-based SaaS resolution that was simple to deploy and simple to arrange.
Cristina:
Our objective was to have a spot the place we might create a catalog of knowledge that was accessible sufficient to the remainder of the corporate. It was additionally vital to know the lineage between Snowflake and PowerBI. Our main objective was to know the impression that modifying a supply would have on our knowledge warehouse, so column-level lineage ensures end-to-end visibility and traceability. Moreover, we acknowledge the necessity for a sturdy software to strengthen safety of our knowledge platform, permitting us to assign roles and permissions to make sure that solely approved folks have entry to particular data, in addition to the power to carry out audits which is important to take care of the integrity and compliance of our knowledge operations.
What do you plan on creating with Atlan? Do you have got an thought of what use circumstances you’ll construct, and the worth you’ll drive?
Cristina:
One of many necessities we had is to create considerably of a market for our knowledge, with all the pieces based mostly on Atlan property, and we’re engaged on launching that to start with of this 12 months. From there, we’re trying ahead to populating much more metadata in Atlan and Snowflake.
Sooner or later, we’re enthusiastic about the potential for utilizing Atlan AI. Our objective is to make accessing knowledge even simpler for folks, and having the ability to chat with Atlan about knowledge would make it simple for folks to search out what they want.
Picture by Mario Caruso on Unsplash
