Blog - The Big Data Landscape

Big Data and IT Operations: These Apps Are Revolutionizing Efficiency

binary-208216_150Businesses are utilizing IT Operations Analytics platforms to identify issues, increase efficiency of application systems and their performance, and to deliver easily understandable insights to IT and management teams.

IT Operations Analytics (ITOA) solutions provide real-time analytics for monitoring applications. These solutions automatically identify and isolate disruptions and failures, and give IT operations teams the opportunity and the tools to solve problems faster than ever. These solutions enable decision makers to analyze large amounts of APM data faster and more intelligently.

ITOA platforms utilize Big Data analytics to bring immediate awareness of potential issues, along with rapid understanding of those issues from both a technical and business point of view, to IT Operations teams. These ITOA solutions provide insights into how disruptions will affect both the technical and business aspects of a company, and they provide suggestions for correcting any problems that arise. Read on to find out more about these innovative IT Operations Analytics platforms.

Companies and Apps in the Big Data and IT Operations space:

All descriptions are from companies’ websites.


Monitor your IT systems and infrastructure in real time to identify issues, problems and attacks before they impact your customers, services and revenue. Splunk Enterprise keeps watch of specific patterns, trends and thresholds in your machine-generated data so you don’t have to. Trigger notifications in real time via email or RSS, execute a script to take remedial actions, send an SNMP trap to your system management console or generate a service desk ticket.

New Relic

New Relic is a Software Analytics company that makes sense of billions of metrics across millions of apps. We help the people who build modern software understand the stories their data is trying to tell them.


The AppDynamics Application Intelligence platform is uniquely able to deliver rich performance data, learning, and analytics, combined with the flexibility to adapt to virtually any infrastructure or software environment. What’s more, our low-overhead architecture means that you can deploy in production and benefit from real-time data collection and analysis.

Sumo Logic

The basic architecture of Sumo Logic’s cloud log management system revolves around the best practice of divide-and-conquer by composing many small and independent services in order to build a scalable, flexible log management platform. Major components of the Sumo Logic system, such as the log data intake and collection management facilities, the full-text indexing pipeline, and the interactive analytics platform, are encapsulated into a set of decoupled services. Each service employs a set of shared lower-level modules to make use of common functionality. Each service runs as an independent executable, and each service can scale independently of the others in the cloud based on demand and the specific CPU and I/O requirements of each service.


Now Big Data technologies applied by HP Software help solve IT issues. With highly scalable data collection, embedded HP Vertica and Arcsight based analytics capabilities, HP Operations Analytics is a powerful new HAVEn standalone solution for IT Operations.


IBM IT Operations Analytics solutions analyze the terabytes of big data from your IT operations. These solutions turn your data into understandable, relevant information and insights that you can act on immediately. These solutions help you: Predict problems before they occur. Search quickly across massive amounts of data. Optimize across your IT & App infrastructure. IT Operations Analytics solutions use: Cognitive computing capabilities to learns about a business’ IT systems over time. As business and performance conditions change the software adapts, changing settings and eliminating inadvertent but costly errors caused by poor system configuration. Advanced text analytics engine able to extract insights from both structured and unstructured data sources (service tickets, performance metrics and support documents).


Netuitive’s advanced analytics platform assures the performance of mission-critical applications and the complex and dynamic environments that support them. Netuitive adds an intelligence layer on top of your existing systems, application, and business monitoring tools. Enabled by our patented Behavior Learning Engine™, Netuitive continuously correlates and analyzes in real time every contributor to application health, anywhere in your enterprise, to deliver your current reactive, break-fix approach to performance management into a truly proactive experience.


Evolven’s IT Operations Analytics provides intelligent answers to key IT operations challenges: how to accelerate incident resolution, how to avoid harmful and risky changes, and how to assess and optimize IT operations performance. Evolven’s new analytics approach to the chronic change & configuration challenges dramatically minimizes the risk of downtime and slashes incident investigation time.

INETCO Insight

INETCO Insight is a core platform for ITOA. It provides an application-centric view of how all parts of an enterprise system are performing, drawing on a powerful analytic model – our Unified Transaction Model – to make sense of large volumes of application performance and event data. It includes easy-to-use capabilities for alerting, visualizing Big Data Analytics, and isolating performance issues. INETCO Insight also forwards rich performance and application monitoring information into other IT management and operations intelligence systems like IBM TivoliNetcool/OMNIbus, HP Operations Manager, NCR APTRA Vision, and Splunk Enterprise — so you can harness Big Data across your ITOA architecture.

CA Technologies

Our converged approach to infrastructure management takes on the heavy lifting by translating huge volumes of data into actionable insight. Overburdened I&O teams can easily access graphic displays of the information they need to improve service quality, predictability, and efficiency so they can deliver superior, differentiated customer experience with less effort and reduced costs. Combining your network management, applications and system management under the umbrella of converged infrastructure management offers the following benefits: Speed proactive triage and remediation with less effort with analytics translating disparate data into intelligent views for up to 25x faster problem resolution. Shift operations costs to innovation through reducing total costs by as much as 50 percent. Achieve massive scalability and accelerated time-to-market demands for the largest, most complex enterprises and service providers to improve performance.

Continuity Software

The AvailabilityGuard Risk Discovery Engine™ automatically scans your IT infrastructure in a non-intrusive, read-only mode, collecting up-to-date configuration information from servers and clusters, storage devices, virtual infrastructure, database servers, and the networks that connect them across physical, virtual, and hybrid environments. It then analyzes the information gathered against the continuously updated Risk Signature Knowledgebase™ and pinpoints any misconfigurations that can lead to potential downtime and data loss.


By analyzing the massive amounts of wire data traversing the network, the ExtraHop platform provides the real-time, cross-tier visibility that IT Operations teams need to manage increasingly complex applications and infrastructure. Continuously adapting to changes in the IT environment, the ExtraHop platform analyzes performance across all tiers of the application delivery chain, including network, VDI, web, middleware, database, and storage.


OpTier leverages patented technology to make ITOA a reality within our APM solution. Our end-to-end transaction tracing technology captures key performance and business data, which connects the individual silos of your IT infrastructure. This rich and dynamic data set enables a much more holistic view of your infrastructure and allows you to provide the context to your data so you can mine APM data more intelligently via analytics.


Distributed applications produce mountains of operational data. Each tier may have dozens or hundreds of nodes, and each node may have different log files. This volume and complexity can make it very difficult to diagnose problems. Machine data analytics tools help address these challenges by indexing all log data, and enabling aggregatioin and search through this data to identify the root cause of potential problems.  With Boundary, you’ll see IT operations analytics in record time.


SharePath is designed to help enterprise IT teams identify, anticipate and prevent issues. Unlike language-specific, infrastructure or log-based monitoring tools, SharePath is not limited to certain technologies or platforms. Instead, you get complete visibility of all user transactions in the context of their application, environment and performance against SLA. SharePath can trace every individual user-request across any type of technology or platform – not just Java or .NET but including Web-servers, proxy servers, integration layers, etc. – measuring the exact contribution of each element within the datacenter. This provides a fast, accurate answer to the question “What’s really impacting the user’s experience?” and reduces time-to-resolution with 100% confidence.


AccelOps automatically discovers, analyzes and automates IT issues in machine and big data across organizations’ data centers and cloud resources, spanning servers, storage, networks, security, applications and users.


AppsOne’s patent pending Application Behavior Learning (ABL) technology, a unique approach to IT Operations Analytics (ITOA), combines powerful and scalable analytics with auto-discovered real application usage patterns, auto-discovered monitoring thresholds, and real user experience monitoring data. AppsOne analyzes and correlates the dependencies between application load and corresponding infrastructure performance behavior 24×7, to deliver preventive performance management of both on-premise and cloud based applications.

Check Out These Resources for Insights on Big Data and IT Operations:

The Big Data Weekly Roundup, March 3-7, 2014

san-jose-state-university-106864_150This week, we continued our Big Data Resource Series by taking a look at how analytics apps are impacting many areas of our lives. Check out these must-have guides that provide information you need to know about companies, apps, and advice in each of the following areas:

Big Data and Fitness

Big Data and Relationships

Big Data and Health

Big Data and K-12 Education

Big Data and Higher Education

Stay tuned next week; there is a lot more Big Data news to come! Enjoy your weekend!

Big Data and Higher Education: These Apps Change Everything

san-jose-state-university-106865_150Big Data is going to college. The companies on this list have been developing innovative higher education analytics apps. Universities are realizing the importance of harnessing Big Data for the purposes of helping students to succeed, helping instructors to know what students still need to learn, analyzing efficiency in all areas, boosting enrollment, and more.

For example, CourseSmart embeds analytics directly into digital textbooks. These analytics provide an “engagement index score,” which measures how much students are interacting with their eTextbooks (viewing pages, highlighting, writing notes, etc.). Researchers have found that that the engagement index score helps instructors to accurately predict student outcomes more than traditional measurement methods, such as class participation.

In addition, there are dashboards that enable Big Data analytics and visualization for the purpose of monitoring higher education KPIs such as enrollment, accreditation, effectiveness, research, financial information, and metrics by class and by department. Read on to find out about the companies that are shaping Big Data analytics in higher education.

Companies and Apps in the Big Data and Higher Education space:

All descriptions are from companies’ websites.


CourseSmart Analytics is an innovative new solution that measures student engagement with digital course materials in order to provide administrators and faculty with actionable insights to help drive retention and outcomes. A centerpiece of CourseSmart Analytics is the CourseSmart Engagement Index™, a proprietary algorithm that evaluates student usage data points and assimilates them into an overall assessment of students’ engagement with digital material. Used in conjunction with other key indicators such as class participation, homework completion, and exam and other assessment results, CourseSmart Analytics can help improve student retention and outcomes, and ultimately, their success in your course or program.


LabStats is the easiest and most economical software solution for tracking computer usage in colleges and universities. Designed specifically for networked computer environments, LabStats provides a simple and customizable interface to manage every aspect of your computer labs. Save money, back up funding requests with real data and take control of your lab with LabStats. LabStats gathers usage information for every lab machine and stores it indefinitely in a high-efficiency database. LabStats lets lab managers view real-time usage charts in a web browser, rather than relying on lab assistants, manual headcounts and other homegrown solutions.

Civitas Learning

Our platform enables us to ingest data from learning management systems, student information systems, and other sources, then build school-specific predictive models that discover hidden connections and identify key decision points that affect student success. Our products deliver current, personalized, data-informed advice to the front lines of higher education. Students, faculty, advisors, and administrators interact with these clean, user-friendly apps, which distill deep analytical insights into straightforward, actionable guidance. By helping to improve a million small decisions across a college or university, we enable big improvements across the institution.


At the core of the Declara platform is The CognitiveGraph™, a dynamic map of how people learn based on years of research across hundreds of subjects. The CognitiveGraph™ takes every interaction an individual has over the network — be it access to a blog post, a connection to an expert, or a posting of “like” — to deliver the right content and the right learning partners to the right people at just the right time to radically improve learning outcomes. Using advanced algorithms and machine learning, the Declara CognitiveGraph™ learns as the user learns.


Knewton is an education technology company that personalizes digital courses so every student is engaged and no one slips through the cracks. As students progress through a Knewton-powered course, Knewton figures out what each student knows and how that student learns best, then recommends what to study next. Teachers use Knewton-powered predictive analytics to detect gaps in knowledge and differentiate instruction for each student.


ForecastPlus for Recruitment is a highly advanced predictive modeling tool for enrollment management. Powered by customized, multi-variable analyses, it uses your past enrollment data to predict your future enrollment results. Proven effective on more than 100 campuses, ForecastPlus reduces uncertainty and duplication from the admissions process.

Blackboard Analytics

Blackboard Analytics for Learn™ combines the extensive data from Blackboard Learn™ with student and course attributes from your SIS/ERP to create comprehensive reports and dashboards for your students, instructors, staff and leadership. With Blackboard Analytics for Learn, you have easy, self-service access to data that can help give you an enterprise-level perspective. Gain insight into user activity, course design and student grade and learning outcome data across departments and colleges, enabling you to improve your use of the Blackboard Learn platform in support of teaching, learning, and student success.

Desire2Learn Insights

Desire2Learn Insights™ offers a powerful suite of high-performance reports, rich data visualizations and predictive analytic capabilities that enable institutions to discover rich and meaningful insight about the integrity of their learning environment and deliver a perceptive, next generation experience. With the ability to harness the big data available in your learning environment, Insights’ dynamic, outcomes-based reports enable key stakeholders to establish, track, measure and assess achievement across course, program or institution-level. While your focus for improvement might be accreditation support, program design and delivery, or mentoring at-risk learners – whatever the need – Desire2Learn Insights expertly transforms your learning environment data into actionable insights that guide new opportunities for learner and institutional success.


A complex world demands skilled and knowledgeable citizens, yet educational institutions at every level struggle to graduate students who can meet these requirements. As costs rise and funding shrinks, educators and administrators need deeper insight into which approaches work and which do not. Analytics provides them with the tools to measure performance and ensure students acquire the skills to succeed.

PAR Framework by WCET

The Predictive Analytics Reporting (PAR) Framework is a multi-institutional data mining collaborative that brings together 2 year, 4 year, public, proprietary, traditional, and progressive institutions to collaborate on identifying points of student loss and to find effective practices that improve student retention in U.S. higher education. With sixteen member institutions, over 1,700,000 anonymized student records and 8,100,000 institutionally de-identified course level records, the PAR Framework offers educational stakeholders a unique multi-institutional lens for examining dimensions of student success from both unified and contextual perspectives.


Graduate to the next level of performance – with best-in-class software to help your higher education or research institution run better. No matter the size of your organization, we can help boost your international ranking and reputation through superior research, improved student performance, and smarter financial management.


iDashboards Higher Education dashboard software is providing colleges and universities around the country better access to their data and greater insight into their key performance indicators (KPIs). Dashboards are being utilized to monitor Higher Education KPIs such as enrollment, accreditation, effectiveness, institutional research, financials and departmental metrics. Education Dashboards are customized for each institution taking into account their data sources and the goals of the institution.

McGraw-Hill Connect

The first and only analytics tool of its kind, Connect InsightTM is a series of visual data displays—each framed by an intuitive question—to provide at-a-glance information regarding how your class is doing. Initially Connect InsightTM will provide analysis on five key insights, available at a moment’s notice from your tablet device.


In the increasingly competitive market for online higher education, schools must cut through the noise to find and engage with qualified prospects. Higher education marketers must drive profitable new student acquisition through cost-effective investments in online advertising, including cost-per-lead and display advertising. Using eBureau’s advanced predictive analytics at the moment of initial inquiry, marketers can: Lower cost-per-start. Meet and surpass enrollment goals. Boost conversion rates and improve customer service. Understand which leads are likely to apply, enroll, and stay enrolled. After enrollment, eBureau’s big data and predictive analytics tools can help schools: Identify retention risk. Locate past students and alumni.

Tableau Software

Educational institutions have data everywhere: from student and donor data to classes, faculty and grants. Yale University, Cornell University, the University of Oxford and hundreds of other institutions use Tableau for their institutional research initiatives: Analyze student data: enrollment statistics, achievement, and demographics. Target areas of the country for alumni activities and development. Prepare Integrated Postsecondary Education Data System (IPEDS) and other reporting.

Jenzabar Analytics

Better data means better decisions. Jenzabar Analytics puts the power of actionable intelligence in your hands. Our robust solution offers a full range of options that can revolutionize the way that you manage operations and develop institutional strategy. Jenzabar Analytics provides configurable dashboards, alerts, reports, and analytics so you can gain the insight you need to succeed across your institution.


Enrollment Analytics for Colleges and Universities is an analytical platform for your institution to increase educational performance. With access to relevant data from multiple sources, your organization can make better decisions by tracking progress against key performance indicators (KPIs).The Higher Education Analytics tools enables your organization to analyze and identify higher performance factors on test scores, analyze and discover attendance patterns, insight on behavior patterns in relation to student performance, and gain a 360-degree view of teacher and student demographics. Colleges and Universities need to gain comprehensive and in-depth insight on enrolled students including experience, high school performance, academic programs, courses, locations, demographic insights, and external factors on enrollments.

Check Out These Resources for Insights on Big Data and Higher Education:

Big Data and K-12 Education: The Resources You Need

k-12Big Data is revolutionizing K-12 education. Teachers have always used students’ assessment results to shape planning and instruction, and now Big Data is bringing new meaning to the term “data-driven instruction.” Today’s Big Data analytics software and apps for K-12 education are helping teachers to individualize instruction like never before.

These apps utilize adaptive learning algorithms, real-time assessment interpretation, predictive modeling, and real-time analytics to bring the power of systematic, real-time data to teachers and students. These apps and platforms provide performance-tracking capabilities, and some of them provide dashboards and other visual displays that teachers can use to drive instruction and understand students’ strengths as well as the areas in which they need extra support. In addition, students can see and track their own progress with some of these mobile apps, which provides them with immediate, individualized feedback and insights into their own learning.

As mobile devices such as tablets are increasingly being used as learning tools in schools, mobile analytics apps are giving teachers and school districts insights about how those devices are being used so that they can make informed decisions. Keep reading to discover the companies that are spearheading the use of Big Data in K-12 education.

Companies and Apps in the Big Data and K-12 Education space:

All descriptions are from companies’ websites.

EduTrends by LabStats

EduTrends tracks the use of applications, computers and devices for schools. It can track school-issued devices in the classroom, in computer labs, on mobile racks, and it can track devices issued directly to students, even when they take them home. EduTrends can report when and for how long students are interacting with classroom technology to help school leaders make edtech decisions that truly benefit the school and especially the students.


Knewton is an education technology company that personalizes digital courses so every student is engaged and no one slips through the cracks. As students progress through a Knewton-powered course, Knewton figures out what each student knows and how that student learns best, then recommends what to study next. Teachers use Knewton-powered predictive analytics to detect gaps in knowledge and differentiate instruction for each student.


An independent subsidiary of News Corporation, Amplify is built on the foundation of Wireless Generation, the pioneer that brought mobile assessments and instructional analytics to schools across America. To date, Amplify has supported more than 200,000 educators and 3 million students in all 50 states as they begin their digital transition. And we’re just getting started. Our digital products are leading the way in data-driven instruction, breaking new ground in mobile learning and setting the standard for next-generation digital curriculum and assessment.

LearnSmart by McGraw Hill

Each innovative product in the LearnSmart Advantage suite is powered by the proven McGraw-Hill LearnSmart engine that has helped over 2 million student users answer nearly 1.5 billion questions since 2009. All this data has been harnessed to make the LearnSmart Advantage products the most intelligent, reliable and effective adaptive learning tools that are available to students. The five powerful products in the LearnSmart Advantage suite – LearnSmart, SmartBook, LearnSmart Achieve, LearnSmart Prep and LearnSmart Labs – leverage years of historical data and advanced scientific algorithms to ensure that every minute a student spends studying with a LearnSmart Advantage product is the most efficient and productive minute possible at that specific moment for that individual student.


Founded in 2011, by Zynga’s co-founder and first employee, Junyo develops tools and platforms that leverage the enormous power of big-data analytics. We’re developing a broad foundational database that supports multiple applications within education for both B2B and B2C markets. Early investors include angel investors, Learn Capital, NewSchools Venture Fund, and Kapor Capital.

Revolution K12

We strike a healthy balance between an adaptive program for each student and a teachable course for instructors.   While our mentor sessions provide a unique learning pathway for each student that scaffolds back to foundational Math skills, teachers receive real-time data that enables them to teach to students’ collective strengths and weaknesses more effectively and efficiently.


At the core of the Declara platform is The CognitiveGraph™, a dynamic map of how people learn based on years of research across hundreds of subjects. The CognitiveGraph™ takes every interaction an individual has over the network — be it access to a blog post, a connection to an expert, or a posting of “like” — to deliver the right content and the right learning partners to the right people at just the right time to radically improve learning outcomes. Using advanced algorithms and machine learning, the Declara CognitiveGraph™ learns as the user learns.

Learnalytics by Renaissance Learning

Founded on one of the world’s largest databases of student learning data, Learnalytics gives greater insight into what students know, what they like, and how they learn. Learnalytics empowers educators to deliver precise, timely instruction and drive effective, repeated practice.

DreamBox Learning

A key component of successfully delivering blended learning— and the highly personalized learning that results from it— is the ability to leverage data in real time as only DreamBox can. In the moment data Because Intelligent Adaptive Learning uses in-the-moment data to seamlessly integrate instruction with assessment, it is an ideal tool for the every blended learning environment. Current academic progress reporting Fine-grained reporting provides needed insights into proficiency at the district, school, classroom, and student level. DreamBox analyzes over 50,000 pieces of data per hour, to provide the most effectively individualized math learning experience possible. The system interacts with the student by analyzing the data from the student’s actions in real-time as he solves problems, explores concepts, and makes decisions.

Lexia Learning

Lexia provides explicit, systematic, personalized learning on foundational reading skills for students of all abilities, and delivers norm-referenced performance data and analysis without interrupting the flow of instruction to administer a test. This research-proven, technology-based approach accelerates reading skills development, predicts students’ year-end performance and provides teachers data-driven action plans to help differentiate instruction.


Pair a short video with a digital textbook or a series of questions to create a Collection on various topics, like slope, cells, or the Silk Road. Create your own collections or save and customize pre-existing collections by organizing resources that you discover in search, uploading your own resources, and adding or authoring questions to check for student understanding. As your students move through a collection, they can indicate how they feel about each resource they’re studying by selecting a response, from “I can explain!” to “I need help.” Track student reactions to see which resources are resonating with them and where students need additional help. Check for understanding by including a variety of question types in your collection for students to test what they’ve learned and identify areas to review. In the Collection Analytics pane, see a summary of your students responses as well as student reactions.


inBloom is an independent nonprofit organization resulting from efforts within the education community beginning in 2011 to solve a common technology issue facing school districts:  the inability of widely varied electronic instructional technology tools used in classrooms to work in coordination with (or “talk to”) one another. Our technology enables these tools to work together so that teachers can more easily tailor education to the needs, skill level and learning pace of each individual student. It can also help engage parents more deeply in their children’s learning, and save teachers time and schools money. In addition, inBloom’s technology offers a substantial security upgrade to the common resources being used, including paper records or disconnected and antiquated databases with few security features.

Check Out These Resources for Insights on Big Data and K-12 Education:–attack-of-the-recommendation-engines—part-i.html