profile
viewpoint
Charles Zhang dockerzhang Tencent Shenzhen Apache InLong PMC Chair

streamnative/kop 427

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

dockerzhang/ClickHouse 0

ClickHouse® is a free analytics DBMS for big data

dockerzhang/FATE 0

An Industrial Level Federated Learning Framework

dockerzhang/incubator-inlong 0

Apache InLong - a one-stop data streaming platform

dockerzhang/incubator-livy 0

Mirror of Apache livy (Incubating)

dockerzhang/incubator-uniffle 0

Uniffle is a high performance, general purpose Remote Shuffle Service.

dockerzhang/kop 0

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

dockerzhang/KubeFATE 0

Manage federated learning workload using cloud native technologies.

dockerzhang/kyuubi 0

Kyuubi is an enhanced editon of Apache Spark's primordial Thrift JDBC/ODBC Server.

issue closedapache/inlong

[Improve][Manager] The manager issues an audit IDs based on the group mode

Description

When the manager issues an audit ID, it distinguishes between data ingestion and data synchronization.

InLong Component

InLong Manager

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

closed time in 2 days

haifxu

push eventapache/inlong

haifxu

commit sha 3a88a30ba604fdd692f49d3d82f135d7070d2457

[INLONG-8975][Manager] Manager issues an audit IDs based on the group mode (#8976)

view details

push time in 2 days

PR merged apache/inlong

Reviewers
[INLONG-8975][Manager] Manager issues an audit IDs based on the group mode component/manager

Prepare a Pull Request

  • Fixes #8975

Motivation

When the manager issues an audit ID, it distinguishes between data ingestion and data synchronization.

Modifications

When the group mode is data synchronization, the manager issues the audit ID of the source. When the group mode is data ingestion, the manager issues the audit ID of the sink.

+18 -6

0 comment

3 changed files

haifxu

pr closed time in 2 days

PullRequestReviewEvent

push eventapache/inlong

EpicMo

commit sha 67c80b9b30c9d9619f1e391118e82b75b1bdb41a

[INLONG-8973][Sort] Fix redis connector in flink 1.13 typo (#8974)

view details

push time in 2 days

issue closedapache/inlong

[Bug][Sort] Fix PRIMARY KEY desc error in redis readme.

What happened

There is a error description about PRIMARY KEY in flink v1.13 connector-redis demo.

What you expected to happen

Just fix it.

How to reproduce

try as the doc said.

Environment

No response

InLong version

master

InLong Component

InLong Sort

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

closed time in 2 days

liaosunny123

PR merged apache/inlong

[INLONG-8973][Sort] Fix redis connector in flink 1.13 typo component/sort

Prepare a Pull Request

(Change the title refer to the following example)

  • Title Example: [INLONG-XYZ][Component] Title of the pull request

(The following XYZ should be replaced by the actual GitHub Issue number)

  • Fixes #8973

Motivation

Explain here the context, and why you're making that change. What is the problem you're trying to solve?

Modifications

Describe the modifications you've done.

Verifying this change

(Please pick either of the following options)

  • [ ] This change is a trivial rework/code cleanup without any test coverage.

  • [ ] This change is already covered by existing tests, such as: (please describe tests)

  • [ ] This change added tests and can be verified as follows:

    (example:)

    • Added integration tests for end-to-end deployment with large payloads (10MB)
    • Extended integration test for recovery after broker failure

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
  • If a feature is not applicable for documentation, explain why?
  • If a feature is not documented yet in this PR, please create a follow-up issue for adding the documentation
+1 -1

0 comment

1 changed file

liaosunny123

pr closed time in 2 days

PullRequestReviewEvent

issue closedapache/inlong

[Improve][Manager] Support for configuring built-in fields for iceberg

Description

Support for configuring built-in fields for iceberg.

InLong Component

InLong Manager

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

closed time in 3 days

fuweng11

push eventapache/inlong

fuweng11

commit sha 52d73f48c343954f784b51c8c15aaa1599986f52

[INLONG-8951][Manager] Support for configuring built-in fields for iceberg and starrocks (#8952)

view details

push time in 3 days

PR merged apache/inlong

Reviewers
[INLONG-8951][Manager] Support for configuring built-in fields for iceberg and starrocks component/manager component/sort 1.9.x/bugfix

Prepare a Pull Request

  • Fixes #8951

Motivation

Support for configuring built-in fields for iceberg.

Modifications

Support for configuring built-in fields for iceberg.

+221 -20

0 comment

17 changed files

fuweng11

pr closed time in 3 days

PullRequestReviewEvent

push eventdockerzhang/incubator-tubemq-website

dockerzhang

commit sha bfa6f6fb59ed08fd4386088cf51ebe524cba8edc

[INLONG-862][Doc] Add API document

view details

push time in 3 days

push eventapache/inlong

Charles Zhang

commit sha 35987b2ba33c77f1c5a3e99ba92f10b3c18455d9

[INLONG-8965][Doc] Update the description for swagger API (#8966)

view details

push time in 3 days

issue closedapache/inlong

[Improve][Doc] Update the description for swagger API

Description

Update the description for swagger API

InLong Component

Other for not specified component

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

closed time in 3 days

dockerzhang

PR merged apache/inlong

[INLONG-8965][Doc] Update the description for Swagger API component/manager 1.9.x/bugfix

Prepare a Pull Request

(Change the title refer to the following example)

  • Title Example: [INLONG-XYZ][Component] Title of the pull request

(The following XYZ should be replaced by the actual GitHub Issue number)

  • Fixes #8965

Motivation

Update the description for Swagger API, and make the description more accurate.

for https://github.com/apache/inlong-website/pull/863

+3 -3

0 comment

2 changed files

dockerzhang

pr closed time in 3 days

push eventdockerzhang/incubator-tubemq-website

dockerzhang

commit sha d6d8d513594a58d1206cbc81e2144e45d6796f95

[INLONG-862][Doc] Add API document

view details

push time in 3 days

PR opened apache/inlong-website

[INLONG-862][Doc] Add API document

Prepare a Pull Request

(Change the title refer to the following example)

  • Title Example: [INLONG-XYZ][Component] Title of the pull request

(The following XYZ should be replaced by the actual GitHub Issue number)

  • Fixes #862

Motivation

企业微信截图_16952849607071

+19808 -0

0 comment

4 changed files

pr created time in 3 days

create barnchdockerzhang/incubator-tubemq-website

branch : fix-862

created branch time in 3 days

issue openedapache/inlong-website

[Improve][Doc] Add API document

Description

Add API document

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

created time in 3 days

PR opened apache/inlong

[INLONG-8965][Doc] Update the description for Swagger API

Prepare a Pull Request

(Change the title refer to the following example)

  • Title Example: [INLONG-XYZ][Component] Title of the pull request

(The following XYZ should be replaced by the actual GitHub Issue number)

  • Fixes #8965

Motivation

Update the description for Swagger API, and make the description more accurate.

+3 -3

0 comment

2 changed files

pr created time in 3 days

create barnchdockerzhang/incubator-inlong

branch : fix-8965

created branch time in 3 days

issue openedapache/inlong

[Improve][Doc] Update the description for swagger API

Description

Update the description for swagger API

InLong Component

Other for not specified component

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

created time in 3 days

push eventdockerzhang/incubator-inlong

Daniel

commit sha 3ad3e463d8ad981a982bccaa55efb9fa23b2ca3d

[INLONG-6694][Dashboard] Create with filter value first, if there is a filter plugin (#6696)

view details

Lizhen

commit sha 5429c8da73898156ba302181226d365224079cf8

[INLONG-6697][Dashboard] Optimize iceberg sink Required (#6698)

view details

wangpeix

commit sha a904605ade244555cd13039c49de8f395c8a4ca7

[INLONG-6675][Sort] Add metrics.audit.proxy.hosts option to support report metrics (#6692)

view details

Yizhou Yang

commit sha 41f829de81ef4e26fa0e24f2c0520d155f0deb9d

[INLONG-6690][Sort] Fix the multiple migrations of Doris when batch delete was enabled (#6691)

view details

Lizhen

commit sha a763bd5c3edcdae8717e59984f2b0241ad20cdea

[INLONG-6652][Manager] Support MQTT source (#6687)

view details

xueyingzhang

commit sha 1ee16ae39af7f7c12f21a007823ba521e31e5b56

[INLONG-6681][Agent] Handle different sink type configurations (#6683)

view details

chestnufang

commit sha 3b5cb65159e1f70d6e00cb7bce7a90d4f1b65b68

[INLONG-6702][DataProxy] Modify the default network card name to obtain the local IP (#6703) Co-authored-by: chestnufang <chestnufang@tencent.com>

view details

Goson Zhang

commit sha 460ec7d0a1f4e111eb7762563a3f0892cd5308ea

[INLONG-6610][Manager] Support the saving and query of data report-to settings (addendum) (#6701)

view details

vernedeng

commit sha 86cc7aeb26f32375680260feb92dba3aa5816104

[INLONG-6707][Sort] Delay the release of audit metrics (#6712)

view details

vernedeng

commit sha 1071dbb576481cc7798122ba56d4badba3412579

[INLONG-6715][DataProxy] Fix json problem in data proxy (#6716)

view details

vernedeng

commit sha 0bb05a4fb7f9ec5e99302ff9679b97a00d28f2d5

[INLONG-6717][DataProxy] Support BufferQueueChannel (#6718)

view details

fuweng11

commit sha 6f261ceda886d4d686a901bc8647239e4e94534e

[INLONG-6720][Manager] Implement InlongClusterEntityMapper.selectByClusterTag (#6721)

view details

vernedeng

commit sha 44f522d71ca71c521db081310db136d59de4bd60

[INLONG-6706][Sort] Fix wrong kafka sink client id (#6711)

view details

Goson Zhang

commit sha 75247dd58557b6f105bbb886f5244462d4c7d497

[INLONG-6610][Manager] Support query all MQ clusters by cluster tag (addendum) (#6722)

view details

vernedeng

commit sha 8ac370c4a907516250ed08df1a73b1a8ecbd486e

[INLONG-6656][SDK] Support QueryConsumerConfig plugin (#6713)

view details

Lizhen

commit sha 23cfe4add6d1cdd790520480d9241fd41ec7cd6a

[INLONG-6705][Doc] Update the supported Extract Node table (#6710) Co-authored-by: healchow <healchow@gmail.com>

view details

vernedeng

commit sha 0fadf6abe2f2bbf1288dc1d97cd38482f98e38e0

[INLONG-6708][DataProxy] Add more metrics of DataProxy (#6714)

view details

xueyingzhang

commit sha 47d077df488afb80d8676e27ee528d064e3b40b4

[INLONG-6730][Agent] Change MOCK task type (#6731)

view details

averyzhang

commit sha 57d5380fd8fb755d075187de755f13320b152b93

[INLONG-6689][Docker] Support running docker-compose on Arm Chip (#6693)

view details

Lizhen

commit sha e6b58bfebaedfde0d3cdc24180ab299122e29336

[INLONG-6699][Dashboard] Support MQTT source (#6719)

view details

push time in 3 days

issue closedapache/inlong

[Improve][Dashboard] Stream and Sink editable state optimization

Description

No response

InLong Component

InLong Dashboard

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

closed time in 3 days

bluewang

push eventapache/inlong

Lizhen

commit sha dfadbce8321c5ac8542792d1e189d0bb91be59e9

[INLONG-8956][Dashboard] Stream and Sink editable state optimization (#8957)

view details

push time in 3 days

PR merged apache/inlong

[INLONG-8956][Dashboard] Stream and Sink editable state optimization component/dashboard

Prepare a Pull Request

(Change the title refer to the following example)

  • Title Example: [INLONG-XYZ][Component] Title of the pull request

(The following XYZ should be replaced by the actual GitHub Issue number)

  • Fixes https://github.com/apache/inlong/issues/8956

Motivation

Explain here the context, and why you're making that change. What is the problem you're trying to solve?

Modifications

1.Stream and Sink can be modified after successful configuration. 2.Data synchronization Sink field mapping title change. 3.Log query can query restart and deleted logs

Verifying this change

image

image

image

+252 -245

0 comment

27 changed files

bluewang

pr closed time in 3 days

push eventapache/inlong

haifxu

commit sha d38d8099c3b20aac04eb59b7f5951b9b10a5b3a9

[INLONG-8946][Manager] Optimize the audit ID method issued by the manager (#8947)

view details

push time in 3 days

issue closedapache/inlong

[Improve][Manager] Optimize the audit ID method issued by the manager

Description

  1. Currently, the manager only issues audit IDs through the sink type, all are placed in source Flink SQL. image

  2. When using the dashboard to query audit information, the manager should add the source type.

InLong Component

InLong Manager

Are you willing to submit PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

closed time in 3 days

haifxu

PR merged apache/inlong

Reviewers
[INLONG-8946][Manager] Optimize the audit ID method issued by the manager component/manager 1.9.x/bugfix

Prepare a Pull Request

  • Fixes #8946

Motivation

  1. The manager only issues audit IDs through the sink type, all are placed in source Flink SQL. image
  2. When using the dashboard to query audit information, the manager should add the source type.

Modifications

  1. When creating Flink SQL, add the read audit ID to the source; add the send audit ID to the sink.
  2. Add source type when getting audit information.

Verifying this change

image 企业微信截图_16952030682438

+25 -16

0 comment

2 changed files

haifxu

pr closed time in 3 days

more