This is the code I used to participate to KDDCup : https://ogb.stanford.edu/kddcup2021/
Test submission The_Sky_Is_Blue 0.1492 Final submission The_Sky_Is_Blue 0.1423
List of problems :
- https://discuss.pytorch.org/t/how-to-use-multiple-gpus-dataparallel-for-training-a-model-that-used-to-use-one-gpu/20150/3
- https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255
- https://stackoverflow.com/questions/60799655/pytorch-dataparallel-doesnt-work-when-the-model-contain-tensor-operation
- https://stackoverflow.com/questions/50935345/understanding-torch-nn-parameter
- https://discuss.pytorch.org/t/problem-with-reducelronplateau/10499/6
- pytorch/ignite#560
- KevinMusgrave/pytorch-metric-learning#241
- https://github.com/rusty1s/pytorch_geometric/blob/master/docs/source/notes/create_dataset.rst
- facebookresearch/maskrcnn-benchmark#103
- https://discuss.pytorch.org/t/pytorch-windows-eoferror-ran-out-of-input-when-num-workers-0/25918/19
- https://discuss.pytorch.org/t/how-to-combine-multiple-torch-load/114880
- https://discuss.pytorch.org/t/optimizing-based-on-another-models-output/6935/12
- https://discuss.pytorch.org/t/multiple-model-forward-followed-by-one-loss-backward/20868
- https://discuss.pytorch.org/t/training-multiple-models-at-the-same-time/66544/7
- https://zhuanlan.zhihu.com/p/214881074
- https://atcold.github.io/pytorch-Deep-Learning/en/week14/14-3/
- rusty1s/pytorch_sparse#108
- https://discuss.pytorch.org/t/concat-features-from-multiple-pretrained-models-to-do-classification/8214
- https://stats.stackexchange.com/questions/475655/in-training-a-triplet-network-i-first-have-a-solid-drop-in-loss-but-eventually ***
Some github projects or papers used :
- https://github.com/YuGuangWang/PAN/blob/master/pan_benchmark.py
- https://github.com/CoinCheung/triplet-reid-pytorch
- https://github.com/littleredxh/HardNegative
- https://github.com/Lin-Yijie/Graph-Matching-Networks/tree/4d93ca69736e077e56a39273ea61fd2a111f54e6
- https://arxiv.org/pdf/2010.14236.pdf
- https://arxiv.org/pdf/2009.12710v1.pdf
- https://arxiv.org/pdf/2006.16811.pdf
- https://github.com/masashitsubaki/QuantumDeepField_molecule
- https://chemrxiv.org/articles/preprint/SMILES_Pair_Encoding_A_Data-Driven_Substructure_Tokenization_Algorithm_for_Deep_Learning/12339368