Dinkyһվʽʵʱ¼ÆËãƽ̨ v1.0.2

Dinky ÊÇÒ»¸ö¿ªÏä¼´ÓõÄһվʽʵʱ¼ÆËãƽ̨£¬ÒÔ Apache Flink Ϊ»ù´¡£¬Á¬½Ó OLAP ºÍÊý¾ÝºþµÈÖÚ¶à¿ò¼Ü£¬ÖÂÁ¦ÓÚÁ÷ÅúÒ»ÌåºÍºþ²ÖÒ»ÌåµÄ½¨ÉèÓëʵ¼ù¡£

¹¦ÄÜÌصã

ÆäÖ÷Òª¹¦ÄÜÈçÏ£º

1¡¢³Á½þʽ FlinkSQL Êý¾Ý¿ª·¢£º×Ô¶¯Ìáʾ²¹È«¡¢Óï·¨¸ßÁÁ¡¢Óï¾äÃÀ»¯¡¢ÔÚÏßµ÷ÊÔ¡¢Ó﷨УÑé¡¢Ö´Ðмƻ®¡¢MetaStore¡¢ÑªÔµ·ÖÎö¡¢°æ±¾¶Ô±ÈµÈ

2¡¢Ö§³Ö FlinkSQL ¶à°æ±¾¿ª·¢¼°¶àÖÖÖ´ÐÐģʽ£ºLocal¡¢Standalone¡¢Yarn/Kubernetes Session¡¢Yarn Per-Job¡¢Yarn/Kubernetes Application

3¡¢Ö§³Ö Apache Flink Éú̬£ºConnector¡¢FlinkCDC¡¢Table Store µÈ

4¡¢Ö§³Ö FlinkSQL Óï·¨ÔöÇ¿£ºÕû¿âͬ²½¡¢Ö´Ðл·¾³¡¢È«¾Ö±äÁ¿¡¢Óï¾äºÏ²¢¡¢±íÖµ¾ÛºÏº¯ÊýµÈ

5¡¢Ö§³Ö FlinkCDC Õû¿âʵʱÈë²ÖÈëºþ¡¢¶à¿âÊä³ö¡¢×Ô¶¯½¨±í

6¡¢Ö§³Ö SQL ×÷Òµ¿ª·¢£ºClickHouse¡¢Doris¡¢Hive¡¢Mysql¡¢Oracle¡¢Phoenix¡¢PostgreSql¡¢Presto¡¢SqlServer¡¢StarRocks µÈ

7¡¢Ö§³ÖʵʱÔÚÏßµ÷ÊÔÔ¤ÀÀ Table¡¢ ChangeLog¡¢Charts ºÍ UDF

8¡¢Ö§³Ö Flink Catalog¡¢Êý¾ÝÔ´ÔªÊý¾ÝÔÚÏß²éѯ¼°¹ÜÀí

9¡¢Ö§³ÖʵʱÈÎÎñÔËά£ºÉÏÏßÏÂÏß¡¢×÷ÒµÐÅÏ¢¡¢¼¯ÈºÐÅÏ¢¡¢×÷Òµ¿ìÕÕ¡¢Òì³£ÐÅÏ¢¡¢Êý¾ÝµØͼ¡¢Êý¾Ý̽²é¡¢ÀúÊ·°æ±¾¡¢±¨¾¯¼Ç¼µÈ

10¡¢Ö§³Ö×÷Ϊ¶à°æ±¾ FlinkSQL Server ÒÔ¼° OpenApi µÄÄÜÁ¦

11¡¢Ö§³Öʵʱ×÷Òµ±¨¾¯¼°±¨¾¯×飺¶¤¶¤¡¢Î¢ÐÅÆóÒµºÅ¡¢·ÉÊé¡¢ÓÊÏäµÈ

12¡¢Ö§³Ö×Ô¶¯ÍÐ¹ÜµÄ SavePoint/CheckPoint »Ö¸´¼°´¥·¢»úÖÆ£º×î½üÒ»´Î¡¢×îÔçÒ»´Î¡¢Ö¸¶¨Ò»´ÎµÈ

13¡¢Ö§³Ö¶àÖÖ×ÊÔ´¹ÜÀí£º¼¯ÈºÊµÀý¡¢¼¯ÈºÅäÖá¢Jar¡¢Êý¾ÝÔ´¡¢±¨¾¯×é¡¢±¨¾¯ÊµÀý¡¢Îĵµ¡¢È«¾Ö±äÁ¿¡¢ÏµÍ³ÅäÖõÈ

14¡¢Ö§³ÖÆóÒµ¼¶¹ÜÀí£º¶à×⻧¡¢Óû§¡¢½ÇÉ«¡¢ÏîÄ¿¿Õ¼ä

15¡¢¸ü¶àÒþ²Ø¹¦ÄܵȴýС»ï°éÃÇ̽Ë÷

¸üÐÂÄÚÈÝ

ÌØÐÔ£º

CDCSOURCE Õû¿âͬ²½Ö§³ÖдÈë Catalog

Ö§³Öͨ¹ý API »ñÈ¡×÷ÒµµÄ×Ö¶ÎѪԵ

ÐÂÔö Flink Ðм¶È¨ÏÞ

Yarn session Ö§³Ö applicationId ºÍ resource manager ÅäÖÃ

Flink Jar ÈÎÎñÖ§³Ö±¨¾¯

ÐÞ¸´£º

ÐÞ¸´Ïòº£ëàµ÷¶ÈÌá½»×÷ҵʧ°ÜÈ´·µ»Ø³É¹¦µÄÎÊÌâ

ÐÞ¸´Êý¾Ý¿ª·¢µÄѪԵ½Ó¿ÚÒ쳣ʱֻ·µ»Ø¿Õ½á¹û

ÐÞ¸´Ê¹Óà FlinkSQLEnv µÄÈÎÎñÎÞ·¨»ñÈ¡×Ö¶ÎѪԵ

ÐÞ¸´ API δµÇ¼µÄÒì³£

ÐÞ¸´´íÎóµÄ Python Êý¾ÝÀàÐÍ

ÐÞ¸´ÓÉÓÚ jdbc Á¬½Ó³¬Ê±µ¼Ö CDCSOURCE ÎÞ·¨»ñÈ¡ÔªÊý¾Ý

ÐÞ¸´Êý¾ÝÔ¤ÀÀ±í¸ñÎÞ·¨ÏÔʾ Boolean ÀàÐ͵ÄÊý¾Ý

Fix K8S native application ģʽÌá½»ÈÎÎñ±¨´í

ÓÅ»¯£º

ÓÅ»¯Æô¶¯½Å±¾ºÍÒƳýÎÞÓÃÎļþ

Ìí¼Ó×÷ÒµÁ¬½ÓÖеÄ״̬ºÍÓÅ»¯×÷Òµ¼à¿Ø

ÓÅ»¯ÅäÖÃÏîÀ´¿ØÖÆ mysql ÔªÊý¾ÝÖÐµÄ tinyint(1) ת»»Îª Boolean