8000 Can you update finetune_training for selfsupervised_kmeans. · Issue #17 · TongkunGuan/CCD · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Can you update finetune_training for selfsupervised_kmeans. #17
Open
@machoangha

Description

@machoangha

Hi,

I have fine-tuned my model using supervised mode on my custom data. However, when I switch to selfsupervised_kmeans and add the mask file, I notice that the output shapes of the data from the train_data_loader_iter.next() method are inconsistent with those from the supervised mode.

Observations:

  • Supervised Mode Output:

    • First value of item: Size: torch.Size([3, 32, 128])
    • Second value of item: Size: torch.Size([1, 25])
  • Self-Supervised KMeans Mode Output:

    • First value of item: Size: torch.Size([3, 3, 32, 128])
    • Second value of item: Size: torch.Size([32, 128])
    • Third value of item: Size: torch.Size([3, 3])

Context:
The size of each mode is printed in the training script at this line:

image_tensors, label_tensors = train_data_loader_iter.next()
.

Questions:

  1. In the paper, it seems to mention using Self-Supervised learning by creating 2 additional augmented images to form a batch of 3 torch.Size([3, 3, 32, 128]), where the second's size is the mask torch.Size([32, 128]) and the final is the affine matrix torch.Size([3, 3]). Therefore, I believe this is not compatible with the current training script.
  2. Could you please provide the fine-tuning code for selfsupervised mode?

Thank you!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0