Understanding Bayesian Optimization part Computer 1 (AI + Statistics)

Photo by Jack Taylor on UnsplashHigh-dimensional Bayesian Optimization of Hyperparameters for an Attention-based Network to Predict Materials Property: a Case Study on CrabNet using Ax and SAASBO(arXiv)Author : Sterling G. Baird, Marianne Liu, Taylor D. SparksAbstract : Expensive-to-train deep learning models can benefit from an optimization of the hyperparameters that determine the model architecture. We optimize 23 hyperparameters of a materials informatics model, Compositionally-Restricted Attention-Based Network (CrabNet), over 100 adaptive design iterations using two models within the Adaptive Experimentation (Ax) Platform.