#data-management

#data-management

The data that feeds your observability tools is out of control. Too much of it, low quality, unmanaged, and growing faster than anyone budgeted for. When they started building Sawmills two years ago, this was already a serious pain point. Costs were climbing. Signal-to-noise was degrading. Teams were drowning in telemetry that told them less and less while costing more and more.

Patients, for weeks and weeks later, were saying 'where am I going to get care now?' And I was like, 'holy crap, this is really painful.' They had to drive three hours to come to our main sites. And one in three Americans are in this health desert. When care gets shut down, it's a huge problem.

Computer Weekly met up with Glasneck during the UK and Ireland SAP User Group (UKISUG) conference in Birmingham at the start of December to discuss the role of strong data management in successful SAP S4/Hana projects. The company has grown through acquisition. This resulted in 50 or so ERP systems in operation, which were not truly integrated. Imperial Brands recognised it needed to bring all of these legacy ERP systems together into one single S4/Hana instance.

The more things change, the more they stay the same, as the French say. That's certainly the case in enterprise storage. Here we review the storage supplier profiles published this year on ComputerWeekly.com, and find all the key players building on key themes of the past decade. These include: flash storage (often QLC for increased density), hybrid cloud operations, storage and backup for containerised apps, as-a-service models of purchasing, and storage for AI workloads.

Our perspective is that the holders of risk are the beneficiaries of lower costs and reduced risk, but it takes the whole ecosystem to participate. One thing about the Fannie Mae survey is the shift in business priorities from cost cutting to streamlining. Cost cutting and streamlining are related, but cost cutting carries a negative connotation does it mean cutting service, quality or jobs? For years, there was resistance and even regulatory hesitation.

Working with Amazon S3 buckets in the Kubeflow Spark Operator and Python is complicated, with issues surrounding dependency management and file access within worker pods.

AI spreadsheet generators are tools that utilize natural language prompts to facilitate tasks like generating formulas, building tables, and cleaning data without writing any code.

Google Sheets can help you check and edit the data consistency of your spreadsheet. On the menu bar at the top, click Data > Data cleanup > Cleanup suggestions. A panel will open to the right of the screen.

Spreadsheets are broadly accessible but can cause headaches for the unwary, as errors may arise from accidental overwrites or incorrect calculations.

The introduction of PhysicalBackup Custom Resources provides an efficient backup solution, particularly for large datasets, utilizing mariadb-backup and Kubernetes-native VolumeSnapshots.

The MoD faces a complex challenge in managing vast and sensitive datasets in the knowledge that even a single case of data leak or loss can be catastrophic.

Over a quarter of data and analytics professionals worldwide estimate that poor-quality data costs companies over $5 million annually, with 7% putting the figure at $25 million or more.

Amazon S3 lifecycle rules, while promising, often lead to messy and expensive data management due to their one-size-fits-all, timer-based approach.

Shoppers have alternatives, so curating the perfect customer experience requires attention to branding and customer touchpoints, including the critical role of kiosks in retail.

Time travel in Apache Iceberg allows users to precisely identify which data snapshot produced exceptional results, eliminating the need to sift through production logs.

Many users have found automation to be basic and the tool to be less powerful than expected, especially when workflows become more complex.

Google is introducing a new ability on its Chrome browser for iOS that allows users to switch between personal and work profiles, keeping data separate.

A CRM lets you keep track of every interaction with your customers, manage follow-ups, and organise everything in a way that improves customer experience.

AI assistants, if designed improperly, can pose significant risks to privacy and security, potentially exploiting user data without proper controls in place.

Every record begins life in application logic: a TypeScript event, a Java entity, a Python variable. If code produces the data, the correct place to assert expectations is inside the code base.

The Wall Street Journal reported in April 2025 on companies struggling to realize returns on AI. Just weeks later, it covered MIT's retraction of a technical paper about AI.

The FAIR principles have transformed the scientific landscape by ensuring that data is findable, accessible, interoperable, and reusable, thereby enhancing the integrity of research.

"Customers want a model where on-premises infrastructure offers the same flexibility as the cloud. So scalable, quick to deploy, and without long delivery times," Bal explains.

Ethan White, an environmental data scientist, emphasizes that data collection is an ongoing effort, reflecting the importance of maintaining and updating data over time.