Does there have to be a flame on my oven burner?

I tried boiling water and I have the burner turned on, but there's no flame, just the gas coming out. Does it have to have a flame on it? I tried lighting it with a lighter but the flint is worn down. What can I do?