DimeNet and DimeNet++

Description

DimeNet and DimeNet++ represent a significant advancement in the field of molecular graph neural networks. The original DimeNet model, introduced in "Directional Message Passing for Molecular Graphs" (ICLR 2020), leverages directional information to improve message passing between atoms, leading to more accurate representations of molecular structures and properties. This approach enhances the model's ability to capture complex interactions within molecules.

DimeNet++, the successor model presented in "Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Molecules" (NeurIPS-W 2020), builds upon the foundation of DimeNet by introducing substantial improvements in speed and accuracy. It is reported to be up to 8 times faster and 10% more accurate than the original DimeNet, making it a more practical choice for large-scale molecular simulations and drug discovery applications. The implementation provided in this GitHub repository serves as the reference for both models.

The repository includes essential components for running and experimenting with these models. It features notebooks for training (`train.ipynb`) and prediction (`predict.ipynb`), allowing users to easily apply the models to their datasets. For users requiring cluster-based training, a script (`train_seml.py`) integrated with Sacred and SEML is also available. Furthermore, pre-trained models for both DimeNet++ and a TensorFlow 2.0 prototype are provided in the `pretrained` folder, facilitating quicker experimentation and deployment.

Key architectural details and implementation notes are available within the repository, including specific initialization strategies for output layers and discussions on potential issues or bugs. The project is implemented using Python with TensorFlow as the primary deep learning framework, supported by libraries such as NumPy, SciPy, SymPy, and TensorFlow Addons. The project also highlights other implementations in JAX & Haiku and PyTorch Geometric, indicating a vibrant research community around these models. The models are particularly relevant for researchers and developers in computational chemistry, materials science, and cheminformatics seeking to leverage deep learning for molecular property prediction and analysis.

DimeNet and DimeNet++ Highlights

• Directional Message Passing for Molecular Graphs

• DimeNet model architecture

• DimeNet++ model architecture

• Reference implementation

• Training notebook included

• Prediction notebook included

• Cluster training script available

• Pretrained models provided

• TensorFlow 2.0 prototype available

• Focus on energy and force predictions (via GemNet recommendation)

• Uncertainty-aware predictions (DimeNet++)

Getting Started with DimeNet and DimeNet++

1. 1

   Access model: Clone the GitHub repository.

2. 2

   Set up environment: Install required Python packages (TensorFlow, NumPy, SciPy, SymPy, TensorFlow Addons).

3. 3

   Integrate via API: Utilize the provided notebooks or scripts for training and prediction.

4. 4

   Experiment with models: Load pre-trained models for faster iteration.

5. 5

   Adapt for cluster training: Use the `train_seml.py` script for distributed training.

6. 6

   Generate predictions: Use the `predict.ipynb` notebook with trained models.

DimeNet and DimeNet++'s Use Cases

• Molecular Property Prediction
• Drug Discovery
• Materials Science
• Cheminformatics Research
• Computational Chemistry

FAQ from DimeNet and DimeNet++

• What are DimeNet and DimeNet++ models?

  DimeNet and DimeNet++ are advanced neural network models designed for analyzing molecular graphs. They utilize directional message passing to capture complex atomic interactions, enabling accurate predictions of molecular properties.

• What is the difference between DimeNet and DimeNet++?

  DimeNet++ is a successor to DimeNet, offering significant improvements in speed and accuracy. It is reported to be up to 8 times faster and 10% more accurate than the original DimeNet model.

• What kind of predictions can DimeNet models make?

  DimeNet models are designed for predicting molecular properties. The repository also mentions a recommendation for GemNet for energy and force predictions.

• Is the code for DimeNet and DimeNet++ publicly available?

  Yes, the reference implementation for DimeNet and DimeNet++ models is available on GitHub under the repository `gasteigerjo/dimenet`.

• What are the primary research papers for DimeNet and DimeNet++?

  DimeNet was proposed in "Directional Message Passing for Molecular Graphs" (ICLR 2020), and DimeNet++ was introduced in "Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Molecules" (NeurIPS-W 2020).

• Does the repository provide pre-trained models?

  Yes, the repository includes two sets of pre-trained models in the `pretrained` folder for faster experimentation.

• What deep learning framework is used for this implementation?

  This implementation primarily uses TensorFlow (version 2.1 or later) as the deep learning framework.

• Are there any known issues with the code?

  Yes, the repository acknowledges a few known issues and bugs in the code and paper that may require retraining models to fix.

• Can DimeNet models be used for energy and force predictions?

  While DimeNet models are for general molecular property prediction, the authors recommend their newer model, GemNet, specifically for energy and force predictions.

• What are the requirements to run the code?

  The code requires Python with packages such as NumPy, SciPy (>=1.3), SymPy (>=1.5), TensorFlow (>=2.1), TensorFlow Addons, and tqdm.