With the Pandemic that is spread all over the world, the number of users of video calling applications has increased a lot because of the Lock-Down. If you are someone who is chatting with your friends through video calling application then you should definitely know about this cool application- Avatarify.
What is Avatarify?
Want to look like Einstein or Eminem or Donald Trump or Elon Musk, literally whoever you want to look like, you can do it through Avatarify. Or if you are attending a video call with your superiors and you want to present yourself nice and tidy, you can do it with Avatarify.
It is nothing but a cool and interesting application that allows you to change your face into someone else’s face in a video call by just adding it as a plug-in with your video-conferencing application(mostly all of them) and Since, Avatarify and is licensed under Creative Commons Non-Commercial license, which means you are free to use anyone’s face for non-commercial purposes without any legal obligations. Avatarify is based on First Order Motion Model.
This is how Avatarify works!
In order to run Avatarify smoothly, you need a CUDA-enabled (NVIDIA) video card. Otherwise, it will fall back to the central processor and run very slowly. These are performance metrics for some hardware:
- GeForce GTX 1080 Ti: 33 fps
- GeForce GTX 1070: 15 fps
Of course, you also need a webcam!
Avatarify requires a CUDA-enabled NVIDIA GPU to perform heavy tasks. Macbooks don’t have such GPUs, and for processing use CPU, which has much less computing power to run Avatarify smoothly, so we haven’t included it in this blog.
- Download the model’s weights from any of the below-mentioned mediums as per your wish. Dropbox, Mega, Yandex.Disk or Google Drive. The file size is 716 MB.
- Once you have downloaded it, without unzipping the file, place
vox-adv-cpk.pth.tar file in the
avatarify directory. This location can be found on the miniconda prompt page you opened previously.
- Once you are at the location, copy and paste the download file(716MB) on the Avatarify folder.
run_windows.bat. If the installation is successful, two windows “cam” and “avatarify” will appear. That is, one is your face and another is Einstein’s face will appear. Leave these windows open, you will need it for the next installation steps. If there are multiple cameras (including virtual ones) in the system, you may need to select which camera you want. Open
scripts/settings_windows.bat and edit
CAMID is an index number of cameras like 0, 1, 2, …
- Next, Download and Install OBS Studio for capturing Avatarify output. This will help to stream the avatarified face to video conferencing applications like Zoom, Google meet, Skype and many others.
- Now, Download and Install VirtualCam plugin. Choose
Install and register only 1 virtual camera.Press the Go to download to install it. Also while installing, select “Install plugin and register only 1 virtual camera option”.
- Run the OBS Studio application. In the Sources section, press “+” option, select Windows Capture, and press OK. In the window that is appearing next, choose “[python.exe]: avatarify” in Window drop-down menu and then press OK. Now select Edit -> Transform -> Fit to screen.
- In OBS Studio, go to Tools -> VirtualCam. Make sure AutoStart option is checked, set Buffered Frames to 0 and press Start.
OBS-Camerawill be available on video-conferencing applications.
How To Add New Avatars?
This software comes with few avatars as default and if you wish to add new avatars, it is very simple, Go to Avatarify folder, select the Avatars file and paste the .jpg or .png file of the avatar that you wish to look like in your video-conferencing applications.
How To Setup OBS Studio To Various Video-Conferencing Applications
Start the Zoom application, go to Settings, select Video and in the camera option select OBS camera.
Go to Settings -> Audio & Video, choose
Go to your profile picture -> Settings -> Devices and choose
OBS-Camera from Camera drop-down menu.
Make a call, allow browser using cameras, click on Settings icon, choose
OBS-Camera in Video settings drop-down menu.
Basic Controls On Avatarify
|1-9||These will immediately switch between the first 9 avatars.|
|Q||Turns on StyleGAN-generated avatar. Every time you push the button – a new avatar is sampled.|
|0||Toggles avatar display on and off.|
|A/D||Previous/next avatar in the folder.|
|W/S||Zoom camera in/out.|
|U/H/J/K||Translate camera. |
H – left,
K – right,
U – up,
J – Down by 5 pixels. Add
Shift to adjust by 1 pixel.
|Shift-Z||Reset camera zoom and translation|
|Z/C||Adjust avatar target overlay opacity.|
|X||Reset reference frame.|
|F||Toggle reference frame search mode.|
|R||Mirror reference window.|
|T||Mirror output window.|
Do I need any knowledge of programming to run Avatarify?
Not really, but you need some beginner-level knowledge of the command line.
Why haven’t you included how to download on Macbook?
The model used in Avatarify requires a CUDA-enabled NVIDIA GPU to perform heavy computations. Macbooks don’t have such GPUs, and for processing use CPU, which has much less computing power to run Avatarify smoothly so we haven’t included it.
I don’t have an NVIDIA GPU, can I run it?
You still can run it without an NVIDIA GPU, but with drastically reduced performance (<1fps).
I have an ATI GPU (e.g. Radeon). Why does it work so slow?
To run the neural network Avatarify uses the PyTorch library, which is optimized for CUDA. If PyTorch can’t find a CUDA-enabled GPU in your system it will fall back to CPU. The performance on the CPU will be much worse.
My avatar looks distorted.
You need to calibrate your face position. Press X to calibrate your face.
Can I use Avatarify for commercial purposes?
No. Avatarify and First Order Motion Model are licensed under Creative Commons Non-Commercial license, which prohibits commercial use.
What video conferencing apps does Avatarify support?
Avatarify creates a virtual camera that can be plugged into any app where the video input source can be changed (Zoom, Skype, Hangouts, Slack, …).