On the Variance of the Adaptive Learning Rate and Beyond
-
Updated
Jul 31, 2021 - Python
#
adam
Here are 53 public repositories matching this topic...
Learning Rate Warmup in PyTorch
-
Updated
Mar 11, 2025 - Python
ADAM - A Question Answering System. Inspired from IBM Watson
python elasticsearch natural-language-processing wikipedia scikit-learn pandas spacy question-answering gensim adam spacy-extension
-
Updated
Feb 6, 2020 - Python
RAdam implemented in Keras & TensorFlow
-
Updated
Jan 22, 2022 - Python
Pytorch LSTM RNN for reinforcement learning to play Atari games from OpenAI Universe. We also use Google Deep Mind's Asynchronous Advantage Actor-Critic (A3C) Algorithm. This is much superior and efficient than DQN and obsoletes it. Can play on many games
python reinforcement-learning deep-reinforcement-learning openai-gym pytorch lstm reinforcement-learning-algorithms a3c universe adam rmsprop actor-critic asynchronous-advantage-actor-critic reinforcement-agents a3c-lstm
-
Updated
Sep 19, 2024 - Python
Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
-
Updated
Nov 27, 2024 - Python
Easy-to-use AdaHessian optimizer (PyTorch)
-
Updated
Nov 12, 2020 - Python
Toy implementations of some popular ML optimizers using Python/JAX
machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers
-
Updated
Jun 20, 2021 - Python
Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks" (accepted by IJCAI 2020)
-
Updated
Apr 13, 2023 - Python
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
optimizer ranger adam demon lookahead amsgrad adamw radam adamod gradient-centralization qhadam decay-momentum iterate-averaging qhranger adaptive-optimizer hypergradient-descent hd-adam hd-sgd nosadam nostalgic-adam
-
Updated
Sep 23, 2020 - Python
[Python] [arXiv/cs] Paper "An Overview of Gradient Descent Optimization Algorithms" by Sebastian Ruder
adadelta momentum gradient-descent optimization-methods optimization-algorithms adam adagrad rmsprop gradient-descent-algorithm stochastic-optimizers stochastic-gradient-descent gradient-boosting adam-optimizer adamax stochastic-optimization batch-gradient-descent nesterov-accelerated-sgd amsgrad nesterov-momentum nadam
-
Updated
Mar 23, 2019 - Python
Adam, NAdam and AAdam optimizers
-
Updated
Sep 25, 2019 - Python
AdaShift optimizer implementation in PyTorch
-
Updated
Jan 13, 2019 - Python
implementation of neural network from scratch only using numpy (Conv, Fc, Maxpool, optimizers and activation functions)
deep-learning neural-network numpy cnn sgd convolution gradient-descent ann maxpooling adam fully-connected-network adam-optimizer implementation-from-scratch sigmoid-activation relu-activation
-
Updated
Oct 9, 2022 - Python
Tensorflow-Keras callback implementing arXiv 1712.07628
-
Updated
Mar 24, 2023 - Python
Comprehensive image classification for training multilayer perceptron (MLP), LeNet, LeNet5, conv2, conv4, conv6, VGG11, VGG13, VGG16, VGG19 with batch normalization, ResNet18, ResNet34, ResNet50, MobilNetV2 on MNIST, CIFAR10, CIFAR100, and ImageNet1K.
training logging pytorch hyperparameters mnist vgg sgd imagenet image-classification tensorboard resnet cifar adam distributed-training pytorch-implementation tensorboard-pytorch learning-rate-scheduling automatic-mixed-precision learning-rate-warmup small-convolutional
-
Updated
Oct 5, 2021 - Python
Improve this page
Add a description, image, and links to the adam topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the adam topic, visit your repo's landing page and select "manage topics."