Noticeable differences between podman and docker

Anyone used podman for a while should notice differences between podman and docker; especially rootless podman

• Permission issues on folder mounting?
• Subtle differences in command? (podman-compose build db doesn't work)
• podman-compose down is required to kill pods.
• VSCode Docker extension doesn't work properly.

All in all, is it even worthy to switch to podman? Is extra security worth it? I am also not sure if the concept of pod is useful.

Furthermore, Fedora Silverblue specifically uses podman. (Preinstalled with podman, and the system is immutable.)