You can probably ask them to pull the wires there but not install or terminate them for a patch panel.
Because you specified a patch panel, they probably quoted for the installation of the rack and the patch panel, as it’s not there and therefore they need it to complete the task completely.
You’ll end up with loose unterminated wires you can then just put an RJ45 plug on and wire directly to a switch or whatever.
I’d just manage the actual patching with VLANs on the switch. Unless you plan a more complex setup with some jacks going directly to a server or other routers/switches, it should be plentiful to just have 24 live ports you can plug devices into. Fair amount of switches can be simply wall mounted without a rack.