Help configuring Cloudflare Tunnel -> Nginx proxy manager -> Authentik

Hello,

Super new to self hosting in general.

I have been dabbling with self hosting some services. I have setup a VM with Nginx Proxy Manager and Authentik in docker containers and Cloudflare tunnel on the VM.

I believe everything is configured properly. I have port forwarded 80 and 443 just to test the setup and everything works fine. NPM sends me to Authentik to authenticate then on the the requested service.

As soon as i close the ports and transfer to cloudflare tunnel things start to break. I can still access any services I dont have running through authentik perfectly fine, however if i add the authentik config to a proxy host, it sends me to the authentication page as usual however upon logging me in it redirects me infinitly to the login page. I can see my url changing to the requested service but it just keeps sending me back.

Does anyone have a similar setup and can guide me into how to resolve this? I do not really want to have the ports forwarded on my network and would prefer to continue using the cloudflare tunnel.

Cheers!