Skip to content

feat: merge vector arrow buffer#320

Open
iaojnh wants to merge 50 commits intoalibaba:mainfrom
iaojnh:feat/merge-vector-arrow-buffer
Open

feat: merge vector arrow buffer#320
iaojnh wants to merge 50 commits intoalibaba:mainfrom
iaojnh:feat/merge-vector-arrow-buffer

Conversation

@iaojnh
Copy link
Copy Markdown
Collaborator

@iaojnh iaojnh commented Apr 7, 2026

No description provided.

@iaojnh iaojnh requested review from chinaux and zhourrr as code owners April 7, 2026 06:38
Copy link
Copy Markdown
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

@iaojnh iaojnh requested a review from richyreachy as a code owner April 7, 2026 08:41
richyreachy
richyreachy previously approved these changes Apr 8, 2026
int init(const ailego::Params &params) override {
params.get(BUFFER_STORAGE_MEMORY_SIZE, &buffer_size_);
LOG_INFO("buffer size: %lu", buffer_size_);
// LOG_INFO("buffer size: %lu", buffer_size_);
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better to use LOG_DEBUG here, together with other useful debug info, such as file name, some offsets, etc

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

namespace zvec {
namespace ailego {

class LPMap;
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does LPMap mean? Use a meaningful name or write a comment to be readable

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rename it to "VectorPageTable"

if (!ok) {
return false;
}
if (item.lp_map == nullptr) {
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this name seems obsolete

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rename it to VectorPageTable

@@ -18,6 +18,7 @@
#include <unordered_map>
#include <zvec/ailego/internal/platform.h>
#include "concurrentqueue.h"
#include "lru_cache.h"

#if defined(_MSC_VER)
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

vector_page_table.h

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -0,0 +1,151 @@
#pragma once

#include <sys/stat.h>
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

parquet_hash_table.h

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -0,0 +1,158 @@
#include <zvec/ailego/buffer/parquet_buffer_pool.h>
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

copyright header

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@iaojnh iaojnh requested a review from zhourrr April 12, 2026 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants