out of range for slice in next_regex

[marryjianjian]

RESS/src/tokenizer/mod.rs

Line 145 in 31d1faa

String::from_utf8_lossy(&self.stream.buffer[self.current_start..self.stream.idx])

when input is /\ (just 2 char, slash and backslash), it can cause
range end index 3 out of range for slice of length 2

It seems that when found char \ it will call skip_bytes. And this function will not check idx just increase it

[marryjianjian]

Maybe we could use skip instead of skip_bytes when found char \ or check the idx value before throw out that error.
I don't know which solution (or any other) is better.

[FreeMasen]

Thank you for the bug report, we for sure don't want to panic on invalid input. Sorry i haven't been faster to respond but I have been quite busy lately, I can take a look this weekend.

[FreeMasen]

Thank you again for the bug report. I was finally able to take a look this afternoon and found the issue. Assuming that a \ is always an escape sequence in a regex when the stream ends was the issue. I was able to correct this by adding a check that !self.stream.at_end() before skipping ahead.

I should have the 0.11 fix published today and I will need to update the 0.12 version to match

[marryjianjian]

Thanks your fix