LinkedIn open sources its WhereHows data mining software

LinkedIn said it will open source an internal application called WhereHows, which is a data mining portal for enterprise information.

Technically, LinkedIn calls WhereHows "a data discovery lineage portal." From a business perspective, WhereHows is designed to surface data from multiple stores via metadata.

According to LinkedIn, WhereHows has captured the status of 50,000 datasets, 14,000 comments and 35 million job executions good for a storage footprint topping 15 petabytes.

In a blog post, LinkedIn outlined the reasons it built WhereHows--its big data ecosystem was too diversified with multiple applications designed to do one specific job. As a result, LinkedIn has everything from Informatica to Spark to Hive to Oracle to Hadoop to Teradata as well as a bevy of schedulers.;

 

Share it:
Share it:

[Social9_Share class=”s9-widget-wrapper”]

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

You Might Be Interested In

Microservices and big data start to get closer

17 Jun, 2019

Database development and management are changing dramatically, as microservices gain wider use in the enterprise. That’s according to Zhamak Dehghani, …

Read more

Why Image Analytics Holds the Key to Better Big Data Analysis

14 Mar, 2016

In the 2012 Hollywood movie “Act of Valor”, US Navy Seals launch a Raven UAV to procure live video streaming …

Read more

Zuar Discusses Data & Analytics on DM Radio

16 Feb, 2022

Data data data – it’s everywhere and as the title of Eric Kavanagh’s DM Radio Podcast proclaims –> “Bigger and …

Read more

Recent Jobs

Cyber Security Engineer – P2

Hybrid (Aurora, CO, USA)

5 Mar, 2024

Read More

Sr. Manager – Data and Analytics Technical Lead

Hybrid (Dedham, MA, USA)

5 Mar, 2024

Read More

Manager, Business Data and Analytics

Hybrid (Troy, OH, USA)

5 Mar, 2024

Read More

Do You Want to Share Your Story?

Bring your insights on Data, Visualization, Innovation or Business Agility to our community. Let them learn from your experience.

Get the 3 STEPS

To Drive Analytics Adoption
And manage change

3-steps-to-drive-analytics-adoption

Get Access to Event Discounts

Switch your 7wData account from Subscriber to Event Discount Member by clicking the button below and get access to event discounts. Learn & Grow together with us in a more profitable way!

Get Access to Event Discounts

Create a 7wData account and get access to event discounts. Learn & Grow together with us in a more profitable way!

Don't miss Out!

Stay in touch and receive in depth articles, guides, news & commentary of all things data.