Welcome to the changelog for our data analysis tool! Here, you'll find a detailed log of updates, improvements, and fixes made to the tool. Stay up-to-date with the latest features and enhancements.

Latest Releases​

Welcome to the first release of Datastripes! This version introduces a revolutionary way to work with data, combining cutting-edge technology with an intuitive, visual interface. Here's what's included in v1.0.0:

---

🚀 Key Features​

Browser-Native, No-Backend Data Engine​

• Runs entirely in the browser using WASM and WebGPU.
• Works offline with zero setup required.
• Ensures data privacy by keeping everything local.

300+ Drag-and-Drop Nodes​

• Build complex data flows visually with a rich library of nodes.
• Includes nodes for filtering, transforming, visualizing, and more.
• Supports real-time updates as data flows through the pipeline.

AI-Powered Insights​

• Built-in AI Assistant to guide users through workflows.
• Auto-suggests transformations, visualizations, and next steps.
• Generates multi-page AI-driven analysis for deeper insights.

Narrated Dashboards and Exports​

• Create live, interactive dashboards that update in real time.
• Export insights as slideshows, audio/podcasts, or PowerPoint decks.
• Share data stories in formats tailored for diverse audiences.

Embeddable React SDK​

• Seamlessly integrate Datastripes into your applications.
• Provide live data analytics and visualization tools to your users.
• Ideal for SaaS platforms, internal tools, and custom applications.

---

🛠️ Technical Highlights​

• Local-First Architecture: No backend or cloud dependencies, ensuring high trust and compliance for industries like finance, healthcare, and defense.
• Multi-Source Support: Connect to SQL databases, CSV files, APIs, spreadsheets, and real-time event streams.
• Real-Time Data Flows: Visualize and transform data with instant feedback.
• Extensibility: Add custom nodes, visualizations, or integrations via plugins.

---

Technical Details​

• WASM and WebGPU: Utilizes modern web technologies for high performance and responsiveness.
• First Release for Early Adopters: This version is designed for early adopters and developers who want to shape the future of Datastripes.

Bugs Fixed​

• Marlon Van Wyhe has reported graphical error in the feedback module: fixed!
• Robert Nelson has reported that the save button was pretty hard to find: fixed!

Thanks to everyone who provided feedback during the beta phase! Your insights have been invaluable in shaping this release.

Welcome to the first release of Datastripes! This version introduces a revolutionary way to work with data, combining cutting-edge technology with an intuitive, visual interface. Here's what's included in v1.0.0:

---

🚀 Key Features​

Synthetic Scenarios Builder​

• After having launched the ScenarioNode in v1.0.0, this update enhances its capabilities with a user-friendly interface for creating and managing synthetic scenarios.
• Users can now easily define custom scenarios with a visual editor, making it accessible even for those without deep technical expertise.
• The builder supports drag-and-drop functionality to add shocks, adjust parameters, and visualize the impact of different scenarios on your data.
• Provides real-time feedback as you configure scenarios, allowing for immediate adjustments and insights.

---

🛠️ Technical Highlights​

• Synthetic Data Generation: Enhanced capabilities for generating synthetic data, allowing users to create realistic datasets for testing and validation.
• Scenario Management: Improved tools for managing and organizing scenarios, making it easier to switch between different configurations and setups.
• Performance Optimizations: Various under-the-hood improvements to enhance the performance and responsiveness of the platform.

---

Bugs Fixed​

• PDF export issues with complex visualizations have been resolved.
• Fixed a bug where certain scenarios were not saving correctly in the ScenarioNode.

Welcome to the latest release of Datastripes! This version builds upon the foundation of previous updates, introducing new features, enhancements, and critical fixes to improve your data analysis experience.

---

🚀 Key Features​

Enhanced Audio Processing Components​

• Introduced PlayAudioNode for seamless audio playback with intuitive UI controls.
• Replaced the old AudioNode with a new implementation that analyzes audio data and visualizes it using charts.
• Integrated webfft for FFT processing, enabling advanced audio analysis capabilities.

GanttNode for Project Management​

• Added GanttNode and associated icons to streamline project management workflows.
• Provides a visual representation of tasks, timelines, and dependencies for better planning and tracking.

---

🛠️ Technical Highlights​

• Improved Chart Handling: Updated GanttNode and WaterfallNode components for better chart rendering and error management.
• File Handling Enhancements: Enhanced FileDataNode and file worker to support new file types like ARROW and PARQUET.
• Performance Optimizations: Various improvements to ensure smoother and faster interactions across the platform.

---

Bugs Fixed​

• Resolved issues with PDF export functionality for complex visualizations.
• Fixed errors in the ScenarioNode related to event tracking and visualization.
• Addressed minor UI inconsistencies in the Ads component for better user experience.

Welcome to the latest release of Datastripes! This version marks a significant milestone as we transition to a WebAssembly-based Relational Database (Wasm RDB), revolutionizing the way data is processed and analyzed within the platform.

---

🚀 Major Highlights​

Transition to Wasm RDB​

• Analytics-Driven Architecture: Datastripes now leverages a WebAssembly-based Relational Database (Wasm RDB) for high-performance, in-browser data processing.
• Enhanced Query Execution: The new Wasm RDB enables faster SQL query execution, dynamic filtering, and real-time analytics without relying on server-side processing.
• Improved Scalability: Optimized for handling large datasets directly in the browser, reducing latency and improving responsiveness.

Enhanced Node Components​

• MatrixNode: Updated to use outputsSize for dependency tracking, ensuring seamless integration with the Wasm RDB.
• TableNode: Enhanced with a new data prop and pagination icons, leveraging the Wasm RDB for efficient data rendering.
• EventSourceNode: Refined for handling SSE and WebSocket connections with improved stability.
• JavascriptNode: Introduced for executing custom JavaScript code with robust error handling.
• GeoTrailsNode and MapNode: Added for advanced geographical data visualization.
• ClusteringNode and RegressionNode: Implemented for clustering and regression analysis with ECharts integration.
• ContourPlotNode and HexBinningNode: Introduced for rendering contour plots and hexagonal binning visualizations.

---

🛠️ Technical Advancements​

• Wasm RDB Integration: The platform now supports in-browser relational database operations, enabling advanced analytics workflows without external dependencies.
• SQLNode: Added for managing database connections and schema extraction, fully integrated with the Wasm RDB.
• ExecuteNode: Implemented for executing SQL queries with dynamic filtering, powered by the Wasm RDB.
• Database Analysis: Introduced analyze.utils.ts for comprehensive database analysis, including dynamic column type identification and optimized statistical calculations.

---

Bugs Fixed​

• Adjusted EventSourceNode emission intervals and cleanup effects for stability.
• Resolved SQL query formatting inconsistencies in worker utilities.
• Fixed error messages in various workers, replacing "DuckDB query failed" with "Analysis wasted" for clarity.
• Ensured authenticated route components maintain full height on scroll lock.
• Addressed minor UI inconsistencies and improved error handling across the platform.

---

⚡ Performance Optimizations​

• Transitioned to Wasm RDB for unparalleled performance improvements, ensuring smoother and faster interactions across the platform.
• Implemented changes for speed enhancements, further optimizing data processing and visualization workflows.

---

Thank you for using Datastripes! We are excited to bring you the power of Wasm RDB and look forward to seeing how it transforms your data analysis experience.

Welcome to the latest release of Datastripes! This version introduces groundbreaking advancements, including OPFS Integration and Consultancy-as-a-Service (CaaS), alongside our continued commitment to revolutionizing data analysis with a WebAssembly-based Relational Database (Wasm RDB).

---

🚀 Major Highlights​

OPFS Integration​

• Desktop-Class Storage: Datastripes database core, compiled to WebAssembly, now leverages the Origin Private File System (OPFS) for high-performance, client-side data storage.
• Massive Scale: Tested with 10GB CSV files directly in the browser, OPFS enables seamless handling of large datasets without relying on RAM, delivering near-desktop speeds.
• Serverless Architecture: By integrating OPFS, Datastripes achieves a truly serverless, high-performance data analysis tool, empowering users with desktop-class storage in the browser.
• Recommendation: We strongly advocate for OPFS as the foundation for any data-intensive client-side systems, given its unmatched scalability and performance.

Consultancy-as-a-Service (CaaS)​

• Actionable Insights on Demand: Introducing CaaS, a feature that transforms how consultancy is delivered. Simply define your goals, KPIs, or metrics, and receive actionable insights, trends, forecasts, and recommendations instantly.
• Empowering Startups and SMEs: For startups and small-to-medium enterprises, CaaS offers a smarter, faster way to make data-driven decisions, keeping businesses agile and competitive.
• AI-Driven Consultancy: With Datastripes, consultancy-level thinking is now at your fingertips—just tell the system your objectives, and it becomes your consultant for the night.

---

🛠️ Technical Advancements​

• Wasm RDB + OPFS: The integration of OPFS with the Wasm RDB enables in-browser relational database operations with desktop-class storage, revolutionizing client-side analytics workflows.
• SQLNode Enhancements: Fully optimized for OPFS, SQLNode now supports efficient database connections and schema extraction for massive datasets.
• ExecuteNode Improvements: Enhanced to leverage OPFS for executing SQL queries with dynamic filtering, ensuring high performance even with large-scale data.

---

Bugs Fixed​

• Adjusted EventSourceNode emission intervals and cleanup effects for stability.
• Resolved SQL query formatting inconsistencies in worker utilities.
• Fixed error messages in various workers, replacing "DuckDB query failed" with "Analysis wasted" for clarity.
• Ensured authenticated route components maintain full height on scroll lock.
• Addressed minor UI inconsistencies and improved error handling across the platform.

---

⚡ Performance Optimizations​

• Transitioned to Wasm RDB with OPFS for unparalleled performance improvements, ensuring smoother and faster interactions across the platform.
• Optimized data streams to flow directly from OPFS, reducing memory usage and enhancing scalability for large datasets.

---

Thank you for using Datastripes! With the power of Wasm RDB, OPFS, and CaaS, we are excited to bring you the next generation of data analysis tools. We look forward to seeing how these innovations transform your workflows and decision-making processes.

This release focuses on expanding Datastripes' capabilities with new integrations, enhanced data handling, and improved user experience.

---

🚀 Major Highlights​

Hugging Face Space Integration​

• Seamless AI Integration: Introduced the HuggingFaceSpaceNode component, allowing direct interaction with Hugging Face Spaces. This enables users to leverage powerful AI models for various tasks within their data workflows.
• Dynamic Parameter Forms: Enhanced parameter handling with ParameterForm to support dynamic input types and improve usability when configuring AI models.
• Input/Output Mapping: Implemented robust input/output mapping for Hugging Face API calls, ensuring smooth data flow between your Datastripes workflow and external AI models.

Enhanced Export Capabilities​

• PDF & PPTX Export: Added the ability to export dashboards and visualizations to PDF and PPTX formats, facilitating easy sharing and presentation of your insights.

Advanced Data Processing & Visualization​

• Improved Aggregation Node: Updated AggregationNode output rendering and enhanced SQL aggregation queries with TRY_CAST for better type handling, leading to more accurate and reliable results.
• Enhanced TableNode Date/Time Rendering: TableNode now provides better rendering of date/time values, including clear indications for invalid entries.
• Monte Carlo Simulation: Refactored scenario.worker to include Monte Carlo simulation logic, offering more advanced analytical capabilities.

---

🛠️ Technical Advancements​

• Lazy Loading for Node Components: Implemented lazy loading for node components, improving application startup time and overall performance.
• Optimized Node Components: Cleaned up and optimized various node components, removing unused imports and deprecated elements like SpectrogramNode.
• Dashboard Functionality: Enhanced dashboard functionality with improved styling and conditional rendering for a more dynamic and user-friendly experience.
• PDF Processing: Integrated pdf2array into Vite config and created a dedicated pdf.worker file for efficient PDF processing.
• HTTP POST Function Refinement: Modified the post function in http.ts to correctly set default headers, ensuring 'Content-Type' is 'application/json' unless the payload is FormData. Also updated Content-Type header handling for better payload support

---

Bugs Fixed​

• Fixed an issue where certain node parameters were not saving correctly in specific scenarios.
• Removed deprecated nodes and sources
• Resolved UI glitches in the dashboard rendering under specific conditions.
• Improved error handling in the HuggingFaceSpaceNode for better user feedback.