ML MODE: Difference between revisions

From VASP Wiki
No edit summary
No edit summary
Line 10: Line 10:
*{{TAG|ML_MODE}} = TRAIN or train: On-the-fly training.
*{{TAG|ML_MODE}} = TRAIN or train: On-the-fly training.
:Force predictions from the machine learning force field are used to drive the molecular dynamics (MD) simulation. However, if the error estimation performed in each time step indicates a high force error an ab initio calculation is performed instead and the collected energy, forces, and stress are used to improve the machine learning force field.
:Force predictions from the machine learning force field are used to drive the molecular dynamics (MD) simulation. However, if the error estimation performed in each time step indicates a high force error an ab initio calculation is performed instead and the collected energy, forces, and stress are used to improve the machine learning force field.
: There are two possible cases depending on, whether an {{TAG|ML_AB}} is present in the calculation folder or not:
 
:There are two possible cases depending on, whether an {{TAG|ML_AB}} is present in the calculation folder or not:
 
**No {{TAG|ML_AB}} file: On-the-fly training, starting from scratch.
**No {{TAG|ML_AB}} file: On-the-fly training, starting from scratch.
::Sets: {{TAG|ML_ISTART}} = 0
::Sets: {{TAG|ML_ISTART}} = 0
::Note that at the beginning of the MD run, when there is no force field available or it is still poorly trained, ''ab initio'' calculations will happen frequently.
::Note that at the beginning of the MD run, when there is no force field available or it is still poorly trained, ''ab initio'' calculations will happen frequently.
**{{TAG|ML_AB}} file present: Restart on-the-fly training.
**{{TAG|ML_AB}} file present: Restart on-the-fly training.
::Sets: {{TAG|ML_ISTART}} = 1
::Sets: {{TAG|ML_ISTART}} = 1
Line 22: Line 25:


*{{TAG|ML_MODE}} = SELECT or select: Train a force field by reselection of local reference configurations from an existing {{TAG|ML_AB}} file.
*{{TAG|ML_MODE}} = SELECT or select: Train a force field by reselection of local reference configurations from an existing {{TAG|ML_AB}} file.
:Sets: {{TAG|ML_ISTART}} = 3, {{TAG|NSW}} = 1, and {{TAG|ML_CDOUB}} = 4
:Sets: {{TAG|ML_ISTART}} = 3, {{TAG|NSW}} = 1, and {{TAG|ML_CDOUB}} = 4
:In this operation mode, a new machine learning force field is generated from ab initio data provided in the {{FILE|ML_AB}} file. The structures are read in and processed one by one as if harvested via an MD simulation. In other words, the same steps are performed as in on-the-fly training but the source of data is not an MD run but the series of structures available in {{FILE|ML_AB}}. This mode will ignore the list of local reference configurations in the {{FILE|ML_AB}} file and instead will determine a new collection which is written to the resulting {{FILE|ML_ABN}} file. A new iteration through the training structures can lead to a frequent update of the force field. This is quite time-consuming. Increasing {{TAG|ML_CDOUB}} from 2 to 4 for this mode will result in a much less frequent update of the force field. This leads to much more efficient calculations while practically not changing the results. The {{TAG|ML_AB}} file may contain values for ''CTIFOR'' for each training structure. These are the thresholds used to sample that structure from the previous training. If a value for {{TAG|ML_CTIFOR}} is specified in the {{TAG|INCAR}} file, that value is then used and the thresholds from the {{TAG|ML_AB}} are ignored. Otherwise: 1) If thresholds exist in the {{TAG|ML_AB}} they are used. 2) If no thresholds are specified the default value for {{TAG|ML_CTIFOR}} is used.
 
:A new machine learning force field is generated from the ''ab initio'' data provided in the {{FILE|ML_AB}} file. The structures are read in and processed one by one as if harvested in an MD simulation. In other words, the same steps are performed as in on-the-fly training but the source of data is not actual ''ab initial'' calculations in an MD run but the series of structures available in the {{FILE|ML_AB}} file.
 
:'''N.B.''': The list of local reference configurations on the {{FILE|ML_AB}} file will be ignored. Instead a new collection of local reference configurations is determined and written to the resulting {{FILE|ML_ABN}} file.
 
:A new iteration through the training structures can lead to a frequent update of the force field. This is quite time-consuming. Increasing {{TAG|ML_CDOUB}} from 2 to 4 for this mode will result in a much less frequent update of the force field. This leads to much more efficient calculations while practically not changing the results. The {{TAG|ML_AB}} file may contain values for ''CTIFOR'' for each training structure. These are the thresholds used to sample that structure from the previous training. If a value for {{TAG|ML_CTIFOR}} is specified in the {{TAG|INCAR}} file, that value is then used and the thresholds from the {{TAG|ML_AB}} are ignored. Otherwise: 1) If thresholds exist in the {{TAG|ML_AB}} they are used. 2) If no thresholds are specified the default value for {{TAG|ML_CTIFOR}} is used.
{{NB|tip|If calculations for {{TAG|ML_MODE}} {{=}} SELECT are too time-consuming, it is useful to increase {{TAG|ML_MCONF_NEW}} to values around 10-16. Together with {{TAG|ML_CDOUB}} {{=}} 4, this often accelerates the calculations by a factor of 2-4.}}
{{NB|tip|If calculations for {{TAG|ML_MODE}} {{=}} SELECT are too time-consuming, it is useful to increase {{TAG|ML_MCONF_NEW}} to values around 10-16. Together with {{TAG|ML_CDOUB}} {{=}} 4, this often accelerates the calculations by a factor of 2-4.}}
{{NB|mind|This operation mode needs to be used to generate {{VASP}} machine learning force fields from pre-computed or external ab initio data sets.}}
{{NB|mind|This operation mode needs to be used to generate {{VASP}} machine learning force fields from pre-computed or external ab initio data sets.}}

Revision as of 15:50, 14 April 2023

ML_MODE = [string]
Default: ML_MODE = NONE 

Description: String-based tag selecting operation mode for machine learning force fields.

Mind: This tag is only available as of VASP.6.4.0.

This tag acts as a "super tag" and selects the operation mode by selecting the defaults for all other tags. Every tag that is affected by this "super tag" can be overwritten by the user by simply specifying the value for that tag. The following options are available for this tag:

  • ML_MODE = TRAIN or train: On-the-fly training.
Force predictions from the machine learning force field are used to drive the molecular dynamics (MD) simulation. However, if the error estimation performed in each time step indicates a high force error an ab initio calculation is performed instead and the collected energy, forces, and stress are used to improve the machine learning force field.
There are two possible cases depending on, whether an ML_AB is present in the calculation folder or not:
    • No ML_AB file: On-the-fly training, starting from scratch.
Sets: ML_ISTART = 0
Note that at the beginning of the MD run, when there is no force field available or it is still poorly trained, ab initio calculations will happen frequently.
    • ML_AB file present: Restart on-the-fly training.
Sets: ML_ISTART = 1
Before the MD run starts the ML_AB file (a copy of the ML_ABN from a previous training run!) is read and the ab initio data (energies, forces, and stresses) and local reference configurations it contains are used to generate an initial force field. Subsequently, the on-the-fly training MD is started.
N.B.I: None of the structures in the ML_AB file need to match he POSCAR file for the current MD training run in terms of the simulation box, elements, or number of atoms. However, if the same elements appear the initial force field is used for predictions in the current MD run.
N.B.II: The training data contained in the ML_AB file is included in the final machine learning force field, i.e. the ML_FFN file will define a force field applicable to both the structures on the ML_AB file as well as to the current MD simulation. This means that by restarting repeatedly with ML_MODE=TRAIN, and copying the ML_ABN file from the previous run to ML_AB(!), it is possible to iteratively extend the applicability of the a machine learning force field, e.g. by exploring different temperature ranges or element compositions.
  • ML_MODE = SELECT or select: Train a force field by reselection of local reference configurations from an existing ML_AB file.
Sets: ML_ISTART = 3, NSW = 1, and ML_CDOUB = 4
A new machine learning force field is generated from the ab initio data provided in the ML_AB file. The structures are read in and processed one by one as if harvested in an MD simulation. In other words, the same steps are performed as in on-the-fly training but the source of data is not actual ab initial calculations in an MD run but the series of structures available in the ML_AB file.
N.B.: The list of local reference configurations on the ML_AB file will be ignored. Instead a new collection of local reference configurations is determined and written to the resulting ML_ABN file.
A new iteration through the training structures can lead to a frequent update of the force field. This is quite time-consuming. Increasing ML_CDOUB from 2 to 4 for this mode will result in a much less frequent update of the force field. This leads to much more efficient calculations while practically not changing the results. The ML_AB file may contain values for CTIFOR for each training structure. These are the thresholds used to sample that structure from the previous training. If a value for ML_CTIFOR is specified in the INCAR file, that value is then used and the thresholds from the ML_AB are ignored. Otherwise: 1) If thresholds exist in the ML_AB they are used. 2) If no thresholds are specified the default value for ML_CTIFOR is used.
Tip: If calculations for ML_MODE = SELECT are too time-consuming, it is useful to increase ML_MCONF_NEW to values around 10-16. Together with ML_CDOUB = 4, this often accelerates the calculations by a factor of 2-4.
Mind: This operation mode needs to be used to generate VASP machine learning force fields from pre-computed or external ab initio data sets.
  • ML_MODE = REFIT or refit: Refitting of the force field from an existing ML_AB file using the fast version. The following tags are set: ML_ISTART=4 ; ML_LFAST=.TRUE. ; NSW=1 ; ML_IALGO_LINREG=4 ; ML_SIGW0 = 1E-7 ; ML_SIGV0 = 1 ; ML_EPS_LOW = 1E-11. Similar to ML_MODE = SELECT refitting is done based on an existing ML_AB file, but the number of local reference configurations for each species is taken from the ML_AB file. Sparsification is performed on the local reference configurations, so the resulting ML_ABN might contain the same number or fewer local reference configurations than the ML_AB file.
Warning: We strongly advise to use ML_MODE = REFIT if no error estimates are required during production runs.
  • ML_MODE = REFITBAYESIAN or refitbayesian (deprecated); Same as ML_MODE = REFIT but Bayesian regression is employed. The following tags are set: ML_ISTART=4 ; NSW=1 ; ML_IALGO_LINREG=1 ; ML_LFAST=.FALSE.. This results in lower accuracy and much slower force fields than using ML_MODE = REFIT and should be used with caution. On the other hand, this mode allows the generation of ML_FFN files that can calculate Bayesian error estimates.
  • ML_MODE = RUN or run: Force field only mode is executed (ML_ISTART=2). This mode requires an ML_FF file. In this mode, the previously trained machine learning force field is read from the ML_FF file. The MD simulation is driven with predictions from the force field only, no ab initio calculations are performed and no learning is executed. This setting is typically used when the machine learning force field is considered mature and ready for production runs. Optionally if the force field was refitted using ML_MODE=REFITBAYESIAN, the Bayesian error estimate of the energies, forces, and stress can be computed and logged in the ML_LOGFILE by setting the output frequency of the Bayesian errors ML_IERR. The default is ML_IERR=0.
  • ML_MODE = NONE or none: This tag is not used.

If any option other than the above is chosen or any of them is misspelled (be careful to write everything in upper case or lower case letters) the code will exit with an error.


Tip: The user may overwrite the default by specifying any of the machine learning tags in the INCAR file.

Related tags and articles

ML_LMLFF, ML_ISTART, ML_LFAST, ML_IERR, ML_OUTBLOCK, ML_OUTPUT_MODE, ML_IALGO_LINREG, ML_MCONF_NEW, ML_CDOUB, ML_CTIFOR, ML_IERR