Not without creating a huge problem for the British Military. Private Eye have reported on this for some time. The Conservative Government set up contracts with Elbit, an Israeli Military Technology Company. They supply and develop a large amount of our military electronics and control systems. They have a £500 million pound contract to provide manage the UK Military Flight Training System and they have multiple manufacturing facilities in the UK.
If we stop supplying Israel they will stop providing to the Government and I doubt anyone has checked whether these very high tech systems that they are providing can be shut down remotely. They may also start closing their manufacturing plants.
To be fair, Alex Chalk did previously cancel two contracts with Elbit so there is a precedent but more have been issued since.