Cut cauliflower into florets and steam until tender about 10 minutes. Drain. Mash the cauliflower while still warm. Stir cheese, eggs, panko, cayenne and salt to taste.
Coat the bottom of a griddle or skillet with olive oil over medium-high heat. Form the cauliflower mixture into patties about 3 inches across. Cook until golden brown & set, about 3 minutes per side. Keep each batch warm in the oven while you cook the rest.