IEEE

A Hardware-Friendly Alternative to Softmax Function and Its Efficient VLSI Implementation for Deep Learning Applications

Abstract: The Softmax function holds an essential role in most machine learning algorithms. Conventional realization of Softmax necessitates computationally intensive exponential operations and ...
IEEE

Designing Novel Functional Peptides by Manipulating a Temperature in the Softmax Function Coupled with Variational Autoencoder

Abstract: Development of an efficient peptide design method is crucial for tackling medical problems, such as designing antimicrobial peptides for combating drug-resistant pathogens and anticancer ...
GitHub

fra-scarfato/softmax-AVX

The goal is to analyze the performance gains from each method and compare the development effort required. Find the maximum value in the input vector (logits). This is done for numerical stability to ...
Visual Studio Magazine

Neural Network Activation Functions in C#

James McCaffrey explains what neural network activation functions are and why they're necessary, and explores three common activation functions. Understanding neural network activation functions is ...
GitHub

Can quantizer insert for call_function like torch.matmul or torch.nn.functional.softmax in model

I want to test quantization for some call_function like matmul or softmax, and float model was convert to quant model by iterating through model's named_children，however call_function can't found in ...