我正在尝试使用caffe微调预先训练过的模型 . 我有1200个培训样本和300个开发样本 . (简单问题的小数字) . 我将火车划分为100个小批量,每批有12个样本,而Dev分为100个小批量,每个有3个样本 . 我的目标是循环训练并测试每1个时期= 100次迭代 . 现在我想知道以下内容之间的区别:

solver.step(100)

niter = 200
for it in range(niter):
  solver.step(1)

solver.solve()

我知道 step() 执行完整的3个阶段(前进道具,后道具和更新)并将迭代次数作为输入 . 所以,我认为 step(100) 在这个设置中意味着1个时代,并且在200个循环中的 step(1) 意味着2个时期 . 是对的吗? .

另外,当我使用 solver.solve() 我不理解 Test net output #--: 时,为什么还有11个?,输出:

I1128 13:19:55.134804  4229 sgd_solver.cpp:105] Iteration 0, lr = 0.001
I1128 13:20:42.253166  4239 data_layer.cpp:73] Restarting data prefetching from start.
I1128 13:20:44.436962  4229 solver.cpp:330] Iteration 100, Testing net (#0)
I1128 13:20:44.835551  4229 solver.cpp:397]     Test net output #0: accuracy = 0.888889
I1128 13:20:44.835697  4229 solver.cpp:397]     Test net output #1: loss = 1.40894 (* 1 = 1.40894 loss)
I1128 13:20:44.835763  4229 solver.cpp:397]     Test net output #2: prob = 0.333332
I1128 13:20:44.835824  4229 solver.cpp:397]     Test net output #3: prob = 1.03709e-06
I1128 13:20:44.835886  4229 solver.cpp:397]     Test net output #4: prob = 0.666667
I1128 13:20:44.835945  4229 solver.cpp:397]     Test net output #5: prob = 0.333333
I1128 13:20:44.836004  4229 solver.cpp:397]     Test net output #6: prob = 0.333333
I1128 13:20:44.836062  4229 solver.cpp:397]     Test net output #7: prob = 0.333333
I1128 13:20:44.836119  4229 solver.cpp:397]     Test net output #8: prob = 0.333333
I1128 13:20:44.836179  4229 solver.cpp:397]     Test net output #9: prob = 4.97935e-14
I1128 13:20:44.836236  4229 solver.cpp:397]     Test net output #10: prob = 0.666667
I1128 13:21:38.373956  4239 data_layer.cpp:73] Restarting data prefetching from start.
I1128 13:21:40.397017  4229 solver.cpp:447] Snapshotting to binary proto file _iter_200.caffemodel
I1128 13:21:40.884833  4229 sgd_solver.cpp:273] Snapshotting solver state to binary proto file _iter_200.solverstate
I1128 13:21:41.127754  4229 solver.cpp:330] Iteration 200, Testing net (#0)
I1128 13:21:41.419747  4229 solver.cpp:397]     Test net output #0: accuracy = 0.444444
I1128 13:21:41.419805  4229 solver.cpp:397]     Test net output #1: loss = 12.7511 (* 1 = 12.7511 loss)
I1128 13:21:41.419816  4229 solver.cpp:397]     Test net output #2: prob = 0.126513
I1128 13:21:41.419824  4229 solver.cpp:397]     Test net output #3: prob = 0.873487
I1128 13:21:41.419834  4229 solver.cpp:397]     Test net output #4: prob = 1.36409e-10
I1128 13:21:41.419843  4229 solver.cpp:397]     Test net output #5: prob = 5.67621e-21
I1128 13:21:41.419852  4229 solver.cpp:397]     Test net output #6: prob = 0.667183
I1128 13:21:41.419862  4229 solver.cpp:397]     Test net output #7: prob = 0.332817
I1128 13:21:41.419870  4229 solver.cpp:397]     Test net output #8: prob = 4.48244e-05
I1128 13:21:41.419880  4229 solver.cpp:397]     Test net output #9: prob = 0.666622
I1128 13:21:41.419908  4229 solver.cpp:397]     Test net output #10: prob = 0.333333
I1128 13:21:41.419916  4229 solver.cpp:315] Optimization Done.

solver.step(200) 的输出:

I1128 13:47:02.000474  5385 sgd_solver.cpp:105] Iteration 0, lr = 0.001
I1128 13:47:48.170166  5397 data_layer.cpp:73] Restarting data prefetching from start.
I1128 13:47:50.009802  5385 solver.cpp:330] Iteration 100, Testing net (#0)
I1128 13:47:50.403555  5385 solver.cpp:397]     Test net output #0: accuracy = 1
I1128 13:47:50.403700  5385 solver.cpp:397]     Test net output #1: loss = 0.0764709 (* 1 = 0.0764709 loss)
I1128 13:47:50.403764  5385 solver.cpp:397]     Test net output #2: prob = 4.34344e-09
I1128 13:47:50.403823  5385 solver.cpp:397]     Test net output #3: prob = 0.333333
I1128 13:47:50.403883  5385 solver.cpp:397]     Test net output #4: prob = 0.666667
I1128 13:47:50.403942  5385 solver.cpp:397]     Test net output #5: prob = 0.306925
I1128 13:47:50.404002  5385 solver.cpp:397]     Test net output #6: prob = 0.359741
I1128 13:47:50.404062  5385 solver.cpp:397]     Test net output #7: prob = 0.333333
I1128 13:47:50.404121  5385 solver.cpp:397]     Test net output #8: prob = 0.181897
I1128 13:47:50.404181  5385 solver.cpp:397]     Test net output #9: prob = 0.151436
I1128 13:47:50.404240  5385 solver.cpp:397]     Test net output #10: prob = 0.666667
I1128 13:48:39.077320  5397 data_layer.cpp:73] Restarting data prefetching from start.

求解器文件:

test_iter: 3
test_interval: 100
# The base learning rate, momentum and the weight decay of the network.
base_lr: 0.001
#momentum: 0.9
weight_decay: 0.0005
# The learning rate policy
lr_policy: "inv"
gamma: 0.0001
power: 0.75
# Display every 100 iterations
display: 10000
# The maximum number of iterations
max_iter: 200

----- EXPERIMENT -----

我尝试了 solver.step(201) 而不是200,输出类似于 solver.solve()

I1128 13:55:08.297905  5757 sgd_solver.cpp:105] Iteration 0, lr = 0.001
I1128 13:55:56.028899  5769 data_layer.cpp:73] Restarting data prefetching from start.
I1128 13:55:58.175401  5757 solver.cpp:330] Iteration 100, Testing net (#0)
I1128 13:55:58.536119  5757 solver.cpp:397]     Test net output #0: accuracy = 1
I1128 13:55:58.536265  5757 solver.cpp:397]     Test net output #1: loss = 5.43066e-07 (* 1 = 5.43066e-07 loss)
I1128 13:55:58.536326  5757 solver.cpp:397]     Test net output #2: prob = 7.04335e-10
I1128 13:55:58.536393  5757 solver.cpp:397]     Test net output #3: prob = 0.333333
I1128 13:55:58.536453  5757 solver.cpp:397]     Test net output #4: prob = 0.666667
I1128 13:55:58.536512  5757 solver.cpp:397]     Test net output #5: prob = 0.333333
I1128 13:55:58.536571  5757 solver.cpp:397]     Test net output #6: prob = 0.333333
I1128 13:55:58.536628  5757 solver.cpp:397]     Test net output #7: prob = 0.333333
I1128 13:55:58.536685  5757 solver.cpp:397]     Test net output #8: prob = 0.333332
I1128 13:55:58.536743  5757 solver.cpp:397]     Test net output #9: prob = 1.64471e-06
I1128 13:55:58.536801  5757 solver.cpp:397]     Test net output #10: prob = 0.666667
I1128 13:56:50.299724  5769 data_layer.cpp:73] Restarting data prefetching from start.
I1128 13:56:52.169708  5757 solver.cpp:330] Iteration 200, Testing net (#0)
I1128 13:56:52.469816  5757 solver.cpp:397]     Test net output #0: accuracy = 0.555556
I1128 13:56:52.469964  5757 solver.cpp:397]     Test net output #1: loss = 8.99609 (* 1 = 8.99609 loss)
I1128 13:56:52.470028  5757 solver.cpp:397]     Test net output #2: prob = 0.333333
I1128 13:56:52.470088  5757 solver.cpp:397]     Test net output #3: prob = 0.666667
I1128 13:56:52.470146  5757 solver.cpp:397]     Test net output #4: prob = 1.07012e-10
I1128 13:56:52.470206  5757 solver.cpp:397]     Test net output #5: prob = 1.24848e-15
I1128 13:56:52.470264  5757 solver.cpp:397]     Test net output #6: prob = 0.666667
I1128 13:56:52.470322  5757 solver.cpp:397]     Test net output #7: prob = 0.333333
I1128 13:56:52.470381  5757 solver.cpp:397]     Test net output #8: prob = 7.49798e-06
I1128 13:56:52.470438  5757 solver.cpp:397]     Test net output #9: prob = 0.6666
I1128 13:56:52.470496  5757 solver.cpp:397]     Test net output #10: prob = 0.333392

同样的

niter = 201
for it in range(niter):
   solver.step(1)

输出是:

I1128 14:00:35.986286  6020 sgd_solver.cpp:105] Iteration 0, lr = 0.001
I1128 14:01:26.579378  6030 data_layer.cpp:73] Restarting data prefetching from start.
I1128 14:01:28.678328  6020 solver.cpp:330] Iteration 100, Testing net (#0)
I1128 14:01:28.977371  6020 solver.cpp:397]     Test net output #0: accuracy = 0.888889
I1128 14:01:28.977429  6020 solver.cpp:397]     Test net output #1: loss = 0.953584 (* 1 = 0.953584 loss)
I1128 14:01:28.977444  6020 solver.cpp:397]     Test net output #2: prob = 0.333271
I1128 14:01:28.977458  6020 solver.cpp:397]     Test net output #3: prob = 6.24673e-05
I1128 14:01:28.977475  6020 solver.cpp:397]     Test net output #4: prob = 0.666667
I1128 14:01:28.977533  6020 solver.cpp:397]     Test net output #5: prob = 0.333333
I1128 14:01:28.977589  6020 solver.cpp:397]     Test net output #6: prob = 0.333333
I1128 14:01:28.977644  6020 solver.cpp:397]     Test net output #7: prob = 0.333333
I1128 14:01:28.977699  6020 solver.cpp:397]     Test net output #8: prob = 0.333333
I1128 14:01:28.977752  6020 solver.cpp:397]     Test net output #9: prob = 4.3448e-11
I1128 14:01:28.977813  6020 solver.cpp:397]     Test net output #10: prob = 0.666667
I1128 14:02:20.853430  6030 data_layer.cpp:73] Restarting data prefetching from start.
I1128 14:02:22.835402  6020 solver.cpp:330] Iteration 200, Testing net (#0)
I1128 14:02:23.163835  6020 solver.cpp:397]     Test net output #0: accuracy = 0.888889
I1128 14:02:23.163980  6020 solver.cpp:397]     Test net output #1: loss = 0.154905 (* 1 = 0.154905 loss)
I1128 14:02:23.164043  6020 solver.cpp:397]     Test net output #2: prob = 0.666667
I1128 14:02:23.164103  6020 solver.cpp:397]     Test net output #3: prob = 0.333333
I1128 14:02:23.164161  6020 solver.cpp:397]     Test net output #4: prob = 1.96634e-17
I1128 14:02:23.164222  6020 solver.cpp:397]     Test net output #5: prob = 0.0826814
I1128 14:02:23.164280  6020 solver.cpp:397]     Test net output #6: prob = 0.583985
I1128 14:02:23.164340  6020 solver.cpp:397]     Test net output #7: prob = 0.333333
I1128 14:02:23.164405  6020 solver.cpp:397]     Test net output #8: prob = 0.666667
I1128 14:02:23.164464  6020 solver.cpp:397]     Test net output #9: prob = 1.03834e-10
I1128 14:02:23.164525  6020 solver.cpp:397]     Test net output #10: prob = 0.333333

我们可以假设三者相似吗?如果是的话,那么何时使用它们中的每一个?