Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ISSUE-322] Fix archive consume log exception #323

Open
wants to merge 19 commits into
base: master
Choose a base branch
from
Open

[ISSUE-322] Fix archive consume log exception #323

wants to merge 19 commits into from

Commits on Dec 12, 2020

  1. https://github.com/chubaostream/joyqueue/issues/322 

    archive issue: consume log exception jd-opensource#322

归档功能异常：消费归档功能里，在批量进行读取消费记录日志文件的时候，如果读取是在两个文件里进行的(比如批量1000条，500条读取完后再进行下一个文件的500条读取)，操作hbase存储如果出现异常的话进行位置回退处理，此时的回退处理是对1000条整体位置的偏移量进行回退，但偏移量横跨两个文件进行读取计算的，所以会导致回退偏移量设置异常，从而影响整个消费记录日志的存储线程。
    majun87 committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    2bfef81 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2020

  1. 注释多余测试用例

    majun87 committed Dec 13, 2020
    Configuration menu
    Copy the full SHA
    08fe7d5 View commit details
    Browse the repository at this point in the history

  2. 注释多余测试用例

    majun87 committed Dec 13, 2020
    Configuration menu
    Copy the full SHA
    4803344 View commit details
    Browse the repository at this point in the history

  3. 增加测试覆盖率

    majun87 committed Dec 13, 2020
    Configuration menu
    Copy the full SHA
    e08d567 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2020

  1. data-service层去掉archive-hbase的依赖

    majun87 committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    778a84d View commit details
    Browse the repository at this point in the history

  2. 修改开源实现依赖，剔除包括data-service依赖的相关实现

    majun87 committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    2928858 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2020

  1. 调整开源hbase实现类依赖

    majun87 committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    9fbd8c4 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2020

  1. 简单消费归档限流

    majun87 committed Dec 17, 2020
    Configuration menu
    Copy the full SHA
    4672d92 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2020

  1. 生产归档避免raft切换导致的丢数据问题，修改归档相关参数提升归档性能。

    majun87 committed Dec 20, 2020
    Configuration menu
    Copy the full SHA
    c2d5e4a View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2020

  1. 优化归档生产和消费限流

    majun87 committed Dec 23, 2020
    Configuration menu
    Copy the full SHA
    f24d640 View commit details
    Browse the repository at this point in the history

  2. 限流统计

    majun87 committed Dec 23, 2020
    Configuration menu
    Copy the full SHA
    aefb1e3 View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2020

  1. 归档限流设置调整到主题策略配置 重构生产和消费限流实现

    majun87 committed Dec 25, 2020
    Configuration menu
    Copy the full SHA
    b365c2f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/chubaostream/joyqueue

    majun87 committed Dec 25, 2020
    Configuration menu
    Copy the full SHA
    1c45c1d View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2020

  1. Merge branch 'master' of https://github.com/chubaostream/joyqueue

    majun87 committed Dec 28, 2020
    Configuration menu
    Copy the full SHA
    3ed30bb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/chubaostream/joyqueue

    majun87 committed Dec 28, 2020
    Configuration menu
    Copy the full SHA
    c3ed5db View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2020

  1. Merge branch 'master' of https://github.com/chubaostream/joyqueue

    majun87 committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    2378f6f View commit details
    Browse the repository at this point in the history

  2. 修改归档元数据异常问题

    majun87 committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    db76463 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2020

  1. 限流key错误

    majun87 committed Dec 30, 2020
    Configuration menu
    Copy the full SHA
    fd5a8ab View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2021

  1. 开放主题归档限流

    majun87 committed Jan 5, 2021
    Configuration menu
    Copy the full SHA
    7e16ca5 View commit details
    Browse the repository at this point in the history