with vhostuser I cannot use hugepages

In my setup I am using qemu-kvm without openstack. I am trying to use ovs with dpdk. In my xml file I added following lines for the dpdkvhostuser

cpu mode='host-passthrough'
numa
cell id="0" cpus="0-6" memory="16777216" unit='KiB' memAccess="shared"
numa
cpu

I have enabled hugepages during boot time

ot@mvmgptb11hyp01 hyp-1]# cat /proc/meminfo | grep -i huge
AnonHugePages: 126976 kB
HugePages_Total: 100
HugePages_Free: 80
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 1048576 kB

But When I start my vm (virsh start vm1.xml) I am seeing that this vm is not using memory from hugepages, rather it is taking memory from total memory. When I checked the log file I see that it is using
-object memory-backend-file,id=ram-node0,mem-path=/var/lib/libvirt/qemu/ram,share=yes

It should use backend memory as following

-object memory-backend-file,id=ram-node0,mem-path=/dev/hugepages/libvirt/qemu/vm1,share=yes

Any idea how can I use memory from hugepages