FlowBench: A Large Scale Benchmark for Flow Simulation over Complex Geometries

Read original: arXiv:2409.18032 - Published 9/27/2024 by Ronak Tali, Ali Rabeh, Cheng-Hau Yang, Mehdi Shadkhah, Samundra Karki, Abhisek Upadhyaya, Suriya Dhakshinamoorthy, Marjan Saadati, Soumik Sarkar, Adarsh Krishnamurthy and 3 others
Total Score

0

FlowBench: A Large Scale Benchmark for Flow Simulation over Complex Geometries

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper introduces FlowBench, a large-scale benchmark for evaluating flow simulation over complex geometries.
  • FlowBench provides a diverse dataset of 3D flow fields, covering a range of Reynolds numbers and complex geometry configurations.
  • The benchmark aims to drive progress in flow simulation, a critical aspect of many engineering and scientific applications.

Plain English Explanation

The paper presents FlowBench, a new benchmark for evaluating the performance of flow simulation models. Flow simulation is the process of predicting how fluids, such as air or water, will move around objects or through complex systems.

FlowBench provides a diverse dataset of 3D flow field simulations, covering a wide range of scenarios that challenge existing flow simulation methods. These scenarios include different Reynolds numbers, which measure the ratio of inertial to viscous forces, and complex geometries, such as those found in engineering applications like car design or turbine blades.

By providing this comprehensive benchmark, the researchers aim to drive progress in flow simulation. Accurate flow simulation is crucial for many engineering and scientific applications, from designing more efficient vehicles to modeling the behavior of fluids in biological systems. The FlowBench dataset and evaluation framework can help researchers and engineers develop and test new, more powerful flow simulation models.

Technical Explanation

The paper introduces FlowBench, a large-scale benchmark for evaluating flow simulation models over complex geometries. The benchmark consists of a diverse dataset of 3D flow fields, generated using high-fidelity computational fluid dynamics (CFD) simulations.

The FlowBench dataset covers a wide range of Reynolds numbers, from 10^3 to 10^6, and includes a variety of complex geometry configurations, such as cylinders, airfoils, and turbine blades. This diversity of scenarios aims to challenge the capabilities of existing flow simulation methods and drive progress in this important field.

The paper presents the process of generating the FlowBench dataset, including the CFD simulation setup and the steps taken to ensure the quality and consistency of the data. The authors also describe the evaluation protocols and metrics that can be used to assess the performance of flow simulation models on the benchmark.

Critical Analysis

The FlowBench benchmark represents a significant contribution to the field of flow simulation by providing a comprehensive and challenging dataset for evaluating model performance. The diversity of the scenarios covered, ranging from low to high Reynolds numbers and complex geometries, is a key strength of the benchmark.

However, the paper does not address potential limitations or caveats of the FlowBench dataset. For example, it is unclear how well the simulated flow fields capture the full complexity of real-world fluid dynamics, or how the benchmark's performance metrics relate to practical applications.

Additionally, the paper does not discuss potential biases or gaps in the dataset, which could influence the evaluation of flow simulation models. Further research may be needed to understand the limitations and potential issues with the FlowBench benchmark and ensure its fair and effective use in the research community.

Conclusion

The FlowBench benchmark presented in this paper represents a significant step forward in the evaluation of flow simulation models. By providing a large-scale, diverse dataset of 3D flow fields, the benchmark aims to drive progress in this critical field, which underpins many important engineering and scientific applications.

The FlowBench dataset and evaluation framework offer researchers and engineers a valuable tool for testing and improving their flow simulation models, ultimately leading to more accurate and efficient simulations of fluid dynamics in complex real-world scenarios.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

FlowBench: A Large Scale Benchmark for Flow Simulation over Complex Geometries
Total Score

0

FlowBench: A Large Scale Benchmark for Flow Simulation over Complex Geometries

Ronak Tali, Ali Rabeh, Cheng-Hau Yang, Mehdi Shadkhah, Samundra Karki, Abhisek Upadhyaya, Suriya Dhakshinamoorthy, Marjan Saadati, Soumik Sarkar, Adarsh Krishnamurthy, Chinmay Hegde, Aditya Balu, Baskar Ganapathysubramanian

Simulating fluid flow around arbitrary shapes is key to solving various engineering problems. However, simulating flow physics across complex geometries remains numerically challenging and computationally resource-intensive, particularly when using conventional PDE solvers. Machine learning methods offer attractive opportunities to create fast and adaptable PDE solvers. However, benchmark datasets to measure the performance of such methods are scarce, especially for flow physics across complex geometries. We introduce FlowBench, a dataset for neural simulators with over 10K samples, which is currently larger than any publicly available flow physics dataset. FlowBench contains flow simulation data across complex geometries (textit{parametric vs. non-parametric}), spanning a range of flow conditions (textit{Reynolds number and Grashoff number}), capturing a diverse array of flow phenomena (textit{steady vs. transient; forced vs. free convection}), and for both 2D and 3D. FlowBench contains over 10K data samples, with each sample the outcome of a fully resolved, direct numerical simulation using a well-validated simulator framework designed for modeling transport phenomena in complex geometries. For each sample, we include velocity, pressure, and temperature field data at 3 different resolutions and several summary statistics features of engineering relevance (such as coefficients of lift and drag, and Nusselt numbers). %Additionally, we include masks and signed distance fields for each shape. We envision that FlowBench will enable evaluating the interplay between complex geometry, coupled flow phenomena, and data sufficiency on the performance of current, and future, neural PDE solvers. We enumerate several evaluation metrics to help rank order the performance of neural PDE solvers. We benchmark the performance of several baseline methods including FNO, CNO, WNO, and DeepONet.

Read more

9/27/2024

Accelerating Simulation of Two-Phase Flows with Neural PDE Surrogates
Total Score

0

Accelerating Simulation of Two-Phase Flows with Neural PDE Surrogates

Yoeri Poels, Koen Minartz, Harshit Bansal, Vlado Menkovski

Simulation is a powerful tool to better understand physical systems, but generally requires computationally expensive numerical methods. Downstream applications of such simulations can become computationally infeasible if they require many forward solves, for example in the case of inverse design with many degrees of freedom. In this work, we investigate and extend neural PDE solvers as a tool to aid in scaling simulations for two-phase flow problems, and simulations of oil expulsion from a pore specifically. We extend existing numerical methods for this problem to a more complex setting involving varying geometries of the domain to generate a challenging dataset. Further, we investigate three prominent neural PDE solver methods, namely the UNet, DRN, and U-FNO, and extend them for characteristics of the oil-expulsion problem: (1) spatial conditioning on the geometry; (2) periodicity in the boundary; (3) approximate mass conservation. We scale all methods and benchmark their speed-accuracy trade-off, evaluate qualitative properties, and perform an ablation study. We find that the investigated methods can accurately model the droplet dynamics with up to three orders of magnitude speed-up, that our extensions improve performance over the baselines, and that the introduced varying geometries constitute a significantly more challenging setting over the previously considered oil expulsion problem.

Read more

7/17/2024

Flow-Bench: A Dataset for Computational Workflow Anomaly Detection
Total Score

0

Flow-Bench: A Dataset for Computational Workflow Anomaly Detection

George Papadimitriou, Hongwei Jin, Cong Wang, Rajiv Mayani, Krishnan Raghavan, Anirban Mandal, Prasanna Balaprakash, Ewa Deelman

A computational workflow, also known as workflow, consists of tasks that must be executed in a specific order to attain a specific goal. Often, in fields such as biology, chemistry, physics, and data science, among others, these workflows are complex and are executed in large-scale, distributed, and heterogeneous computing environments prone to failures and performance degradation. Therefore, anomaly detection for workflows is an important paradigm that aims to identify unexpected behavior or errors in workflow execution. This crucial task to improve the reliability of workflow executions can be further assisted by machine learning-based techniques. However, such application is limited, in large part, due to the lack of open datasets and benchmarking. To address this gap, we make the following contributions in this paper: (1) we systematically inject anomalies and collect raw execution logs from workflows executing on distributed infrastructures; (2) we summarize the statistics of new datasets, and provide insightful analyses; (3) we convert workflows into tabular, graph and text data, and benchmark with supervised and unsupervised anomaly detection techniques correspondingly. The presented dataset and benchmarks allow examining the effectiveness and efficiency of scientific computational workflows and identifying potential research opportunities for improvement and generalization. The dataset and benchmark code are publicly available url{https://poseidon-workflows.github.io/FlowBench/} under the MIT License.

Read more

6/14/2024

LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flow
Total Score

0

LayeredFlow: A Real-World Benchmark for Non-Lambertian Multi-Layer Optical Flow

Hongyu Wen, Erich Liang, Jia Deng

Achieving 3D understanding of non-Lambertian objects is an important task with many useful applications, but most existing algorithms struggle to deal with such objects. One major obstacle towards progress in this field is the lack of holistic non-Lambertian benchmarks -- most benchmarks have low scene and object diversity, and none provide multi-layer 3D annotations for objects occluded by transparent surfaces. In this paper, we introduce LayeredFlow, a real world benchmark containing multi-layer ground truth annotation for optical flow of non-Lambertian objects. Compared to previous benchmarks, our benchmark exhibits greater scene and object diversity, with 150k high quality optical flow and stereo pairs taken over 185 indoor and outdoor scenes and 360 unique objects. Using LayeredFlow as evaluation data, we propose a new task called multi-layer optical flow. To provide training data for this task, we introduce a large-scale densely-annotated synthetic dataset containing 60k images within 30 scenes tailored for non-Lambertian objects. Training on our synthetic dataset enables model to predict multi-layer optical flow, while fine-tuning existing optical flow methods on the dataset notably boosts their performance on non-Lambertian objects without compromising the performance on diffuse objects. Data is available at https://layeredflow.cs.princeton.edu.

Read more

9/10/2024