VR is very subject to the hardware you have and the scenes you're displaying. You have to keep in mind that we're rendering the scene multiple times, one for each eye and on screen. Camera views can be hefty by themselves let alone 3 times (or 4 if you're showing both eyes on screen).
You can sometimes increase performance by simplifying the scene like turning off shadows, reflections, and bloom, as well as Ambient Occlusion. Ambient Occlusion particularly can be a hog on resources.
All of these settings can be found in the Camera Specification.
The Rendering Technique used can also affect performance. Physically Based is a lot heftier than Standard.
This article has some additional considerations you might review: https://www.homedesignersoftware.com/support/article/KB-03092/virtual-reality-and-chief-architect-products.html
There is an "Update Lighting on Teleport" setting in the VR dialog that you might double check if your lighting isn't updating as you travel around.
As for if the trouble you're seeing is due to Hardware or Project? You could send a copy in to Tech Support and see if we get the same performance on our side with different hardware.
Hope this helps!
Carrie