test: extended query mode / 3rd-party tools are not well tested

[BugenZhao]

Recently there was a regression (#14102) for not being able to connect RisingWave with 3rd-party tools, which primarily relies on the extended query mode. Despite the timely release of the quick fix in v1.5.2, we still didn't conduct any testing on it. As a result, it could be easily broken again in the future (#14105 (review)).

As shown in e2e_test/extended_mode, very limited cases are tested with extended mode.

risingwave/e2e_test/extended_mode/type.slt

Lines 21 to 28 in d5a8184

	include ../batch/types/boolean.slt.part
	include ../batch/types/cast.slt.part
	include ../batch/types/date.slt
	include ../batch/types/intercal.slt.part
	include ../batch/types/number_arithmetic.slt.part
	include ../batch/types/temporal_arithmetic.slt.part
	include ../batch/types/time.slt.part
	include ../batch/types/timestamptz_utc.slt.part

I would suggest adding more tests for extended mode query by focusing on the real cases. Possible approaches:

• Integrate 3rd-party tools in CI and emulate some basic operations. For GUI tools, use GUI automation.
• Manually emulate basic operations with 3rd-party tools, then dump the queries into a sqllogictest case.
  However, it's worth noting that sqllogictest-rs does not have full support on postgres extended mode: only prepare and query is covered. Improvements need to be made to support parse, bind, execute, describe and so on.

[xxchan]

#9958

[TennyZhuang]

#14116

[wangrunji0408]

Would simulation test help? I once created an issue #5552 but thought it was low priority.

[BugenZhao]

Would simulation test help? I once created an issue #5552 but thought it was low priority.

I believe we should first make sqllogictest-rs support more extended-mode messages. Alternatively, we can bypass using slt as the intermediate representation and program directly in simulation tests.

[BugenZhao]

Opened an issue in sqllogictest-rs: risinglightdb/sqllogictest-rs#205

[fuyufjh]

@xuefengze Can you take a look? Perhaps query with different (go/java/...) clients can also solve this. May need more discussion.

[github-actions]

This issue has been open for 60 days with no activity. Could you please update the status? Feel free to continue discussion or close as not planned.

[fuyufjh]

Duplicated #8213