Geophysics Velocity Model Prediction Using Generative AI for Improved Subsurface Understanding

Author

Posted Oct 23, 2024

Reads 1.2K

An artist’s illustration of artificial intelligence (AI). This illustration depicts language models which generate text. It was created by Wes Cockx as part of the Visualising AI project l...
Credit: pexels.com, An artist’s illustration of artificial intelligence (AI). This illustration depicts language models which generate text. It was created by Wes Cockx as part of the Visualising AI project l...

Generative AI has revolutionized the field of geophysics, particularly in velocity model prediction. This powerful tool can generate high-resolution velocity models that improve subsurface understanding.

Using generative AI, geophysicists can create detailed models of the subsurface, enabling more accurate predictions of seismic data. This enhances the ability to locate hydrocarbon reservoirs and reduce exploration risks.

By leveraging generative AI, geophysicists can generate multiple velocity models, allowing for the identification of the most probable model. This approach minimizes the need for manual iteration and improves the overall efficiency of the velocity model prediction process.

The use of generative AI in geophysics velocity model prediction has shown significant improvements in model accuracy. For instance, in one study, the introduction of generative AI led to a 30% increase in model accuracy compared to traditional methods.

Methodology

To predict geophysics velocity models using generative AI, we first need to understand the methodology behind it. This involves training a neural network on a large dataset of seismic images.

Credit: youtube.com, Manual is not always the best way. AI in Geophysics

The dataset used in this study consisted of 10,000 2D seismic images, each with a size of 256x256 pixels. These images were obtained from various locations around the world.

The neural network architecture used in this study was a Generative Adversarial Network (GAN), specifically designed for image-to-image translation tasks. This architecture consists of two neural networks: a generator and a discriminator.

The generator network takes in a random noise vector and produces a synthetic seismic image that resembles the real thing. The discriminator network, on the other hand, evaluates the generated image and tells the generator whether it's realistic or not.

The training process involves an iterative process where the generator and discriminator networks compete with each other to produce more realistic images. This process continues until the generator produces images that are indistinguishable from real seismic images.

On a similar theme: Generative Ai Architecture

Three Numerical Experiments

We tested our method on the OpenFWI Deng et al. (2021) dataset, which includes 336000 velocity samples with a model size of 64×64 and a spatial interval of 10 m in both horizontal and vertical directions.

Credit: youtube.com, Data & learning-based approaches for modelling, forecasting & reconstruction of geophysical dynamics

The dataset consists of eight classes of models, including "FlatVel-A", "FlatVel-B", "CurveVel-A", "CurveVel-B", "FlatFault-A", "FlatFault-B", "CurveFault-A", and "CurveFault-B".

We utilized 2D velocity models in our tests. The backbone of the diffusion model is a U-Net with attention blocks, which was used in our experiments.

The diffusion model was trained using an Adam optimizer with a learning rate of 1e-4. A batch size of 1024 was used, and the maximum training iteration was set to 200000.

The diffusion timesteps, t, was set to 1000 and embedded via a sinusoidal positional encoding into each residual block.

Training and Performance

The VelocityGPT framework has been tested on the OpenFWI benchmarking dataset, demonstrating its robustness as a seismic velocity generator.

This framework shows remarkable efficiency and adaptability, as a VelocityGPT model trained on smaller velocity models can generate larger, more realistic models without additional training.

By combining the strengths of VQ-VAE and GPT, the VelocityGPT framework produces high-quality seismic velocity models, representing a significant advancement in the field of velocity modeling in data science.

The framework's conditional abilities allow for precise control over velocity generation, as demonstrated by its ability to generate velocities that closely align with desired criteria, such as well logs and reflectivity images.

Autoregressive GPT Training

Credit: youtube.com, Sigma-GPTs: A New Approach to Autoregressive Models

The autoregressive GPT training is a crucial stage in generating new velocity samples. This stage utilizes discrete representations obtained from the VQ-VAE to feed into the GPT model.

The GPT model's architecture is designed to effectively model the distribution of velocity models, enabling the generation of realistic and high-fidelity samples. This is achieved through the use of an embedding block, which projects one-hot encoded discrete latent codes into a hidden dimension, enhancing the model's ability to learn complex patterns.

The decoder blocks, a stack of Transformer decoders, process the embedded data using masked multi-headed self-attention to predict subsequent velocity values based on previous inputs. This process allows the GPT model to generate new velocity samples that are consistent with the input data.

Here are the key components of the autoregressive GPT training stage:

  • Embedding block: Projects one-hot encoded discrete latent codes into a hidden dimension.
  • Decoder blocks: A stack of Transformer decoders processes the embedded data using masked multi-headed self-attention.

By leveraging the autoregressive GPT training, the model can generate new velocity samples that are both realistic and high-fidelity, making it a powerful tool for a variety of applications.

Performance and Applications

A professional woman wearing safety gear, hardhat, and reflective vest surveying outdoors.
Credit: pexels.com, A professional woman wearing safety gear, hardhat, and reflective vest surveying outdoors.

The proposed framework has been tested on the OpenFWI benchmarking dataset, demonstrating its robustness as a seismic velocity generator.

This framework has shown impressive results, generating high-quality seismic velocity models with ease.

A VelocityGPT model trained on smaller velocity models can generate larger, more realistic models without additional training, highlighting the model's efficiency and adaptability in various geological contexts.

This capability is a significant advancement in the field of velocity modeling in data science, combining the strengths of VQ-VAE and GPT to produce high-quality seismic velocity models.

Geological Considerations

Geological Considerations play a crucial role in geophysics velocity model prediction using generative AI. Geological features significantly impact the interpretation of seismic data.

Different rock types exhibit varying velocities, which can affect the accuracy of velocity modeling. This is because different rock types have distinct physical properties that influence seismic wave propagation.

The layering of geological formations, or stratigraphy, affects fluid flow and can be modeled to predict reservoir behavior. This is essential for optimizing oil and gas extraction.

Credit: youtube.com, Velocity Modeling Overview

Faults and fractures can create barriers or conduits for fluid movement, influencing velocity profiles. Understanding these features is vital for accurate velocity modeling.

Here are some key geological features to consider:

  • Rock Types: Sandstone, shale, and limestone have different velocities.
  • Stratigraphy: Layering affects fluid flow and reservoir behavior.
  • Faults and Fractures: These features impact velocity profiles and fluid movement.

Conclusion

Our research has shown that a controllable velocity synthesis framework using diffusion models can yield high-diversity and high-quality velocity synthesis.

This framework allows for different ways to control the velocity synthesis, such as reconstruction-guided sampling and classifier-free guidance diffusion models.

The classifier-free guidance diffusion model can stably generate the velocity given the target conditions, including single or integrated multiple conditions.

The cross-attention mechanism can handle image-like conditions, such as subsurface structure, and produce highly accurate velocity generation control.

This method shows great potential to support multi-model prior information incorporation for diffusion-regularized FWI and provide massive and diverse training datasets to augment training for neural network-based inversion algorithms.

For another approach, see: Learning Generative Ai

Framework Overview

The VelocityGPT framework is designed to enhance the generation of seismic velocity models through a two-stage process. This innovative approach allows for the effective encoding and decoding of velocity models, facilitating the generation of high-quality velocity samples.

At its core, VelocityGPT integrates Vector-Quantized Variational Autoencoders (VQ-VAE) and Generative Pre-trained Transformers (GPT) to achieve this goal.

Sources

  1. A Physics-guided Generative AI Toolkit for Geophysical ... (arxiv.org)
  2. https://doi.org/10.1093/gji/ggab298 (doi.org)
  3. http://library.seg.org/doi/10.1190/1.1441754 (seg.org)
  4. https://doi.org/10.1190/geo2019-0438.1 (doi.org)
  5. https://www.sciencedirect.com/science/article/pii/S2666544120300034 (sciencedirect.com)
  6. https://doi.org/10.1016/j.aiig.2020.12.002 (doi.org)
  7. https://doi.org/10.1190/geo2019-0815.1 (doi.org)
  8. https://doi.org/10.1190/tle40070534.1 (doi.org)
  9. Migration images guided high-resolution velocity modeling ... (sciopen.com)
  10. Google Scholar (google.com)
  11. CrossRef (doi.org)
  12. Google Scholar (google.com)
  13. CrossRef (doi.org)
  14. Google Scholar (google.com)
  15. Google Scholar (google.com)
  16. CrossRef (doi.org)
  17. Google Scholar (google.com)
  18. CrossRef (doi.org)
  19. CrossRef (doi.org)
  20. Google Scholar (google.com)
  21. CrossRef (doi.org)
  22. Google Scholar (google.com)
  23. Google Scholar (google.com)
  24. Google Scholar (google.com)
  25. Google Scholar (google.com)
  26. Google Scholar (google.com)
  27. CrossRef (doi.org)
  28. Google Scholar (google.com)
  29. CrossRef (doi.org)
  30. CrossRef (doi.org)
  31. Google Scholar (google.com)
  32. Google Scholar (google.com)
  33. Google Scholar (google.com)
  34. Google Scholar (google.com)
  35. Google Scholar (google.com)
  36. Google Scholar (google.com)
  37. CrossRef (doi.org)
  38. Google Scholar (google.com)
  39. Google Scholar (google.com)
  40. CrossRef (doi.org)
  41. Google Scholar (google.com)
  42. CrossRef (doi.org)
  43. Google Scholar (google.com)
  44. Google Scholar (google.com)
  45. Google Scholar (google.com)
  46. CrossRef (doi.org)
  47. Google Scholar (google.com)
  48. Google Scholar (google.com)
  49. Google Scholar (google.com)
  50. CrossRef (doi.org)
  51. Google Scholar (google.com)
  52. Google Scholar (google.com)
  53. Google Scholar (google.com)
  54. Google Scholar (google.com)
  55. Google Scholar (google.com)
  56. Google Scholar (google.com)
  57. Google Scholar (google.com)
  58. Google Scholar (google.com)
  59. Google Scholar (google.com)
  60. Google Scholar (google.com)
  61. Google Scholar (google.com)
  62. CrossRef (doi.org)
  63. Google Scholar (google.com)
  64. Google Scholar (google.com)
  65. CrossRef (doi.org)
  66. CrossRef (doi.org)
  67. Google Scholar (google.com)
  68. Google Scholar (google.com)
  69. Velocity Modeling in Data Science | Restackio (restack.io)

Jay Matsuda

Lead Writer

Jay Matsuda is an accomplished writer and blogger who has been sharing his insights and experiences with readers for over a decade. He has a talent for crafting engaging content that resonates with audiences, whether he's writing about travel, food, or personal growth. With a deep passion for exploring new places and meeting new people, Jay brings a unique perspective to everything he writes.

Love What You Read? Stay Updated!

Join our community for insights, tips, and more.