Hugging Face's logo

qualcomm
/
Albert-Base-V2-Hf

Text Generation
PyTorch
backbone
android
Model card Files
xet
 Community
Albert-Base-V2-Hf / README.md
qaihm-bot's picture
qaihm-bot
v0.60.0
7421f31 verified
preview code
|
Raw
History Blame Contribute Delete
6.78 kB
metadata 
library_name: pytorch
license: other
tags:
  - backbone
  - android
pipeline_tag: text-generation

Albert-Base-V2-Hf: Optimized for Qualcomm Devices

ALBERT is a lightweight BERT model designed for efficient self-supervised learning of language representations. It can be used for masked language modeling and as a backbone for various NLP tasks.

This is based on the implementation of Albert-Base-V2-Hf found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
QNN_DLC float Universal QAIRT 2.45 Download
TFLITE float Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit Albert-Base-V2-Hf on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for Albert-Base-V2-Hf on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.text_generation

Model Stats:

  • Input resolution: 1x384
  • Model checkpoint: albert/albert-base-v2
  • Model size (float): 43.9 MB
  • Number of parameters: 11.8M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
Albert-Base-V2-Hf QNN_DLC float Snapdragon® X2 Elite 8.037 ms 1 - 1 MB NPU
Albert-Base-V2-Hf QNN_DLC float Snapdragon® X Elite 18.258 ms 1 - 1 MB NPU
Albert-Base-V2-Hf QNN_DLC float Snapdragon® 8 Gen 3 Mobile 12.549 ms 0 - 357 MB NPU
Albert-Base-V2-Hf QNN_DLC float Snapdragon® 8 Gen 1 Mobile 31.832 ms 0 - 326 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 23.485 ms 0 - 2 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 68.849 ms 0 - 324 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 17.581 ms 0 - 12 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® SA8775P 21.928 ms 0 - 307 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® SA8650P 21.928 ms 0 - 307 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® SA8255P 21.928 ms 0 - 307 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® QCS8450 31.832 ms 0 - 326 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 21.804 ms 0 - 2 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 18.258 ms 1 - 1 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® Dragonwing™ Q-8750 9.37 ms 0 - 313 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® SA7255P 68.849 ms 0 - 324 MB NPU
Albert-Base-V2-Hf QNN_DLC float Qualcomm® SA8295P 27.648 ms 0 - 334 MB NPU
Albert-Base-V2-Hf QNN_DLC float Snapdragon® 8 Elite Mobile 9.37 ms 0 - 313 MB NPU
Albert-Base-V2-Hf QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 7.169 ms 0 - 340 MB NPU
Albert-Base-V2-Hf TFLITE float Snapdragon® 8 Gen 3 Mobile 13.057 ms 0 - 376 MB NPU
Albert-Base-V2-Hf TFLITE float Snapdragon® 8 Gen 1 Mobile 32.374 ms 0 - 370 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® Dragonwing™ IQ-8275 69.477 ms 0 - 339 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 17.093 ms 0 - 6 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® SA8775P 22.064 ms 0 - 338 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® SA8650P 22.064 ms 0 - 338 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® SA8255P 22.064 ms 0 - 338 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® QCS8450 32.374 ms 0 - 370 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® Dragonwing™ IQ-9075 22.499 ms 0 - 32 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® Dragonwing™ Q-8750 9.677 ms 0 - 314 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® SA7255P 69.477 ms 0 - 339 MB NPU
Albert-Base-V2-Hf TFLITE float Qualcomm® SA8295P 27.896 ms 0 - 327 MB NPU
Albert-Base-V2-Hf TFLITE float Snapdragon® 8 Elite Mobile 9.677 ms 0 - 314 MB NPU
Albert-Base-V2-Hf TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 7.479 ms 0 - 332 MB NPU

License

  • The license for the original implementation of Albert-Base-V2-Hf can be found here.

References

Community