Skip to content

Support eval mode for dynamicemb and move insert in backward to forward for use_index_dedup=True#136

Merged
shijieliu merged 4 commits into
NVIDIA:mainfrom
shijieliu:fea-dynamic_eval_mode
Aug 13, 2025
Merged

Support eval mode for dynamicemb and move insert in backward to forward for use_index_dedup=True#136
shijieliu merged 4 commits into
NVIDIA:mainfrom
shijieliu:fea-dynamic_eval_mode

Conversation

@shijieliu

@shijieliu shijieliu commented Aug 8, 2025

Copy link
Copy Markdown
Collaborator

Description

  1. support eval mode for dynamicemb
  2. optimize the eval performance for dynamicemb by using find_and_initialize and eliminating unique operation in forward when eval.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@shijieliu shijieliu mentioned this pull request Aug 8, 2025
3 tasks

@jiashuy jiashuy left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to develop find, to support only lookup embedding based on main branch.

Comment thread corelib/dynamicemb/dynamicemb/batched_dynamicemb_function.py
Comment thread corelib/dynamicemb/dynamicemb/batched_dynamicemb_function.py Outdated
Comment thread corelib/dynamicemb/src/dynamic_emb_op.cu Outdated
@WhoisZihan

Copy link
Copy Markdown
Contributor

I've modified with the latest interface, I can refresh the commit later.

@shijieliu
shijieliu force-pushed the fea-dynamic_eval_mode branch 2 times, most recently from 928b21b to fd2810c Compare August 9, 2025 01:37
Comment thread corelib/dynamicemb/test/test_batched_dynamic_embedding_tables.py
Comment thread corelib/dynamicemb/dynamicemb/batched_dynamicemb_tables.py

@jiashuy jiashuy left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@shijieliu
shijieliu force-pushed the fea-dynamic_eval_mode branch from fd2810c to 59b97bd Compare August 11, 2025 10:06
@shijieliu

Copy link
Copy Markdown
Collaborator Author

hi @WhoisZihan could you help review this PR?

Comment thread corelib/dynamicemb/dynamicemb/optimizer.py
@shijieliu shijieliu changed the title Support eval mode for dynamicemb Support eval mode for dynamicemb and move insert in backward to forward for use_index_dedup=True Aug 12, 2025
@WhoisZihan

Copy link
Copy Markdown
Contributor

LGTM overall, I guess we can finish the review in later PRs.

@jiashuy jiashuy left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved, I will rebase it in Cache&Storage refactor.

@shijieliu
shijieliu merged commit 44525fb into NVIDIA:main Aug 13, 2025
fshhr46 pushed a commit to fshhr46/recsys-examples that referenced this pull request Mar 25, 2026
…rd for use_index_dedup=True (NVIDIA#136)

* Support eval mode for dynamicemb

* dynamicemb support eval_initializer

* refactor lookup_dense; support lookup_dense_eval

* fix perf bug and update perf number for dynamicemb

---------

Co-authored-by: Zihan Yang <whois.zihan.yang@gmail.com>
fshhr46 pushed a commit to fshhr46/recsys-examples that referenced this pull request Mar 25, 2026
…rd for use_index_dedup=True (NVIDIA#136)

* Support eval mode for dynamicemb

* dynamicemb support eval_initializer

* refactor lookup_dense; support lookup_dense_eval

* fix perf bug and update perf number for dynamicemb

---------

Co-authored-by: Zihan Yang <whois.zihan.yang@gmail.com>
fshhr46 pushed a commit to fshhr46/recsys-examples that referenced this pull request Mar 25, 2026
…rd for use_index_dedup=True (NVIDIA#136)

* Support eval mode for dynamicemb

* dynamicemb support eval_initializer

* refactor lookup_dense; support lookup_dense_eval

* fix perf bug and update perf number for dynamicemb

---------

Co-authored-by: Zihan Yang <whois.zihan.yang@gmail.com>
fshhr46 pushed a commit to fshhr46/recsys-examples that referenced this pull request Mar 25, 2026
…rd for use_index_dedup=True (NVIDIA#136)

* Support eval mode for dynamicemb

* dynamicemb support eval_initializer

* refactor lookup_dense; support lookup_dense_eval

* fix perf bug and update perf number for dynamicemb

---------

Co-authored-by: Zihan Yang <whois.zihan.yang@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants