當(dāng)前位置：首頁 > 人工智能 > Caffe >内容正文

Caffe

Caffe代码导读（4）：数据集准备

發(fā)布時(shí)間：2025/3/21 Caffe 151 豆豆

生活随笔收集整理的這篇文章主要介紹了 Caffe代码导读（4）：数据集准备小編覺得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.

轉(zhuǎn)載自：

Caffe代碼導(dǎo)讀（4）：數(shù)據(jù)集準(zhǔn)備 - 卜居 - 博客頻道 - CSDN.NET?

?http://blog.csdn.net/kkk584520/article/details/41649281

Caffe上面有兩個(gè)比較簡單的例子：MNIST和CIFAR-10，前者是用于手寫數(shù)字識(shí)別的，后者用于小圖片分類。這兩個(gè)數(shù)據(jù)集可以在Caffe源碼框架中用腳本（CAFFE_ROOT/data/mnist/get_mnist.sh和CAFFE_ROOT/data/cifar10/get_cifar10.sh）下載，如下圖所示：

[plain] view plaincopyprint?

$?./get_cifar10.sh??

Downloading...??

--2014-12-02?01:20:12--??http://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz??

Resolving?www.cs.toronto.edu...?128.100.3.30??

Connecting?to?www.cs.toronto.edu|128.100.3.30|:80...?connected.??

HTTP?request?sent,?awaiting?response...?200?OK??

Length:?170052171?(162M)?[application/x-gzip]??

Saving?to:?“cifar-10-binary.tar.gz”??

100%[===========================================================================================================================================================>]?170,052,171??859K/s???in?2m?16s??

2014-12-02?01:22:28?(1.20?MB/s)?-?“cifar-10-binary.tar.gz”?saved?[170052171/170052171]??

Unzipping...??

Done.??

$?ls??

batches.meta.txt??data_batch_1.bin??data_batch_2.bin??data_batch_3.bin??data_batch_4.bin??data_batch_5.bin??get_cifar10.sh??readme.html??test_batch.bin??

$ ./get_cifar10.sh Downloading... --2014-12-02 01:20:12-- ?http://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz Resolving www.cs.toronto.edu... 128.100.3.30 Connecting to www.cs.toronto.edu|128.100.3.30|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 170052171 (162M) [application/x-gzip] Saving to: “cifar-10-binary.tar.gz”100%[===========================================================================================================================================================>] 170,052,171 ?859K/s ? in 2m 16s2014-12-02 01:22:28 (1.20 MB/s) - “cifar-10-binary.tar.gz” saved [170052171/170052171]Unzipping... Done. $ ls batches.meta.txt ?data_batch_1.bin ?data_batch_2.bin ?data_batch_3.bin ?data_batch_4.bin ?data_batch_5.bin ?get_cifar10.sh ?readme.html ?test_batch.bin [plain] view plaincopyprint?

$?./get_mnist.sh??

Downloading...??

--2014-12-02?01:24:25--??http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz??

Resolving?yann.lecun.com...?128.122.47.89??

Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??

HTTP?request?sent,?awaiting?response...?200?OK??

Length:?9912422?(9.5M)?[application/x-gzip]??

Saving?to:?“train-images-idx3-ubyte.gz”??

100%[===========================================================================================================================================================>]?9,912,422???2.09M/s???in?6.7s??

2014-12-02?01:24:33?(1.42?MB/s)?-?“train-images-idx3-ubyte.gz”?saved?[9912422/9912422]??

--2014-12-02?01:24:33--??http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz??

Resolving?yann.lecun.com...?128.122.47.89??

Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??

HTTP?request?sent,?awaiting?response...?200?OK??

Length:?28881?(28K)?[application/x-gzip]??

Saving?to:?“train-labels-idx1-ubyte.gz”??

100%[===========================================================================================================================================================>]?28,881??????42.0K/s???in?0.7s??

2014-12-02?01:24:34?(42.0?KB/s)?-?“train-labels-idx1-ubyte.gz”?saved?[28881/28881]??

--2014-12-02?01:24:34--??http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz??

Resolving?yann.lecun.com...?128.122.47.89??

Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??

HTTP?request?sent,?awaiting?response...?200?OK??

Length:?1648877?(1.6M)?[application/x-gzip]??

Saving?to:?“t10k-images-idx3-ubyte.gz”??

100%[===========================================================================================================================================================>]?1,648,877????552K/s???in?2.9s??

2014-12-02?01:24:39?(552?KB/s)?-?“t10k-images-idx3-ubyte.gz”?saved?[1648877/1648877]??

--2014-12-02?01:24:39--??http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz??

Resolving?yann.lecun.com...?128.122.47.89??

Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??

HTTP?request?sent,?awaiting?response...?200?OK??

Length:?4542?(4.4K)?[application/x-gzip]??

Saving?to:?“t10k-labels-idx1-ubyte.gz”??

100%[===========================================================================================================================================================>]?4,542???????19.8K/s???in?0.2s??

2014-12-02?01:24:40?(19.8?KB/s)?-?“t10k-labels-idx1-ubyte.gz”?saved?[4542/4542]??

Unzipping...??

Done.??

$?ls??

get_mnist.sh??t10k-images-idx3-ubyte??t10k-labels-idx1-ubyte??train-images-idx3-ubyte??train-labels-idx1-ubyte??

$ ./get_mnist.sh Downloading... --2014-12-02 01:24:25-- ?http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz Resolving yann.lecun.com... 128.122.47.89 Connecting to yann.lecun.com|128.122.47.89|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 9912422 (9.5M) [application/x-gzip] Saving to: “train-images-idx3-ubyte.gz”100%[===========================================================================================================================================================>] 9,912,422 ? 2.09M/s ? in 6.7s2014-12-02 01:24:33 (1.42 MB/s) - “train-images-idx3-ubyte.gz” saved [9912422/9912422]--2014-12-02 01:24:33-- ?http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz Resolving yann.lecun.com... 128.122.47.89 Connecting to yann.lecun.com|128.122.47.89|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 28881 (28K) [application/x-gzip] Saving to: “train-labels-idx1-ubyte.gz”100%[===========================================================================================================================================================>] 28,881 ? ? ?42.0K/s ? in 0.7s2014-12-02 01:24:34 (42.0 KB/s) - “train-labels-idx1-ubyte.gz” saved [28881/28881]--2014-12-02 01:24:34-- ?http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz Resolving yann.lecun.com... 128.122.47.89 Connecting to yann.lecun.com|128.122.47.89|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1648877 (1.6M) [application/x-gzip] Saving to: “t10k-images-idx3-ubyte.gz”100%[===========================================================================================================================================================>] 1,648,877 ? ?552K/s ? in 2.9s2014-12-02 01:24:39 (552 KB/s) - “t10k-images-idx3-ubyte.gz” saved [1648877/1648877]--2014-12-02 01:24:39-- ?http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz Resolving yann.lecun.com... 128.122.47.89 Connecting to yann.lecun.com|128.122.47.89|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 4542 (4.4K) [application/x-gzip] Saving to: “t10k-labels-idx1-ubyte.gz”100%[===========================================================================================================================================================>] 4,542 ? ? ? 19.8K/s ? in 0.2s2014-12-02 01:24:40 (19.8 KB/s) - “t10k-labels-idx1-ubyte.gz” saved [4542/4542]Unzipping... Done. $ ls get_mnist.sh ?t10k-images-idx3-ubyte ?t10k-labels-idx1-ubyte ?train-images-idx3-ubyte ?train-labels-idx1-ubyte
如果你下載出現(xiàn)問題可以從我的資源處獲取，網(wǎng)址http://download.csdn.net/detail/kkk584520/8213463。

原始數(shù)據(jù)集為二進(jìn)制文件，需要轉(zhuǎn)換為leveldb或lmdb才能被Caffe識(shí)別。轉(zhuǎn)換格式的工具已經(jīng)集成在Caffe代碼中，見CAFFE_ROOT/examples/mnist/convert_mnist_data.cpp

和CAFFE_ROOT/examples/cifar10/convert_cifar_data.cpp，如果對leveldb或lmdb操作不熟悉可以從這兩個(gè)源代碼中學(xué)習(xí)。我們只需要在CAFFE_ROOT目錄中執(zhí)行兩條命令即可：

./examples/mnist/create_mnist.sh

./examples/cifar10/create_cifar10.sh

總結(jié)

以上是生活随笔為你收集整理的Caffe代码导读（4）：数据集准备的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。

上一篇： Caffe代码导读（2）：LMDB简介
下一篇： Caffe代码导读（5）：对数据集进行T