When data gets big: Best practices for data preparation at scale

When data gets big: Best practices for data preparation at scale

Today we work with data that has grown up in diversity, scale and complexity — this applies to not only data scientists and academic researchers, but also the rest of us. Business analysts across a spectrum of industries are asked to include larger volumes of data in their work, now pervasive due to diminishing costs of collection and storage. Answering …

7 Ways to Handle Large Data Files for Machine Learning

7 Ways to Handle Large Data Files for Machine Learning

Exploring and applying machine learning algorithms to datasets that are too large to fit into memory is pretty common. This leads to questions like: In this post, I want to offer some common suggestions you may want to consider. Some machine learning tools or libraries may be limited by a default memory configuration. Check if you can re-configure your tool …

Three Key Steps For Manufacturers To Realize Their Big Data Age Dreams

Three Key Steps For Manufacturers To Realize Their Big Data Age Dreams

Now that the age of big data is really here, manufacturing companies have truly game-changing opportunities to increase operating efficiency and productivity — and even explore new “digital” business models taking advantage of the Internet of Things. However, a big obstacle stands in their way: manufacturers’ extraordinarily data-rich and complex global supply chains are generating digital data at an unprecedented …

Modeling and analytics and their role in business [Q&A]

Modeling and analytics and their role in business [Q&A]

Businesses are collecting more data about their operations and their customers than ever before. But data in itself is only part of the story. For it to be useful it’s necessary to spot patterns and gain insights. At this point most businesses turn to analytics, but this can only tell you what’s happened in the past. To predict future trends …

5 Reasons to Use Business Intelligence at Your Call Center

5 Reasons to Use Business Intelligence at Your Call Center

People often speak of business intelligence (BI) in the same breath as “business performance improvement” (BPI) and “informed decision-making.” Both statements are true and entirely applicable to the modern call center. However, business intelligence holds other benefits for your call center or collections agency. We discuss a few of them here, alongside the aforementioned BPI and decision-making. Allow yourself to …

Moving beyond spreadsheets into enterprise-ready statistical analysis

Moving beyond spreadsheets into enterprise-ready statistical analysis

For most knowledge workers, spreadsheets can be an attractive choice for performing calculations. If the task is to carry out simple tests on a small number of variables, then a spreadsheet is as good a tool as any. Its principal advantages are ubiquity, familiarity and ease of use.  However,  spreadsheets may prove to be inadequate for a wide range of …