코알파카 LLM 모델을 아파치 플라스크에서 실행시키는데 에러로그를 봐도 무슨 에러인지 모르겠습니다.

Question

# MODEL &#61; 'beomi/KoAlpaca-Polyglot-5.8B'# model &#61; AutoModelForCausalLM.from_pretrained(# MODEL,# torch_dtype&#61;torch.float16,# low_cpu_mem_usage&#61;True# ).to(device&#61;f&#34;cuda&#34;, non_blocking&#61;True)# model.eval() # pipe &#61; pipeline(# 'text-generation',# model&#61;model,# tokenizer&#61;MODEL,# device&#61;0# ) # &#64;app.route(&#34;/example&#34;, methods&#61;['GET', 'POST'])# def chat6():# response &#61; &#34;&#34;# user_input&#61;&#34;&#34;# if request.method &#61;&#61; 'POST':# user_input &#61; request.form['user_input']# response &#61; ask(user_input)# chat_history_1day.append({&#34;user&#34;: user_input, &#34;bot&#34;: response})# # 역순으로 정렬# input_time &#61; time.strftime('%Y.%m.%d %H:%M:%S') # new_data &#61; {'question': [user_input], 'answer': [response],'time': [input_time]}# df &#61; pd.DataFrame(new_data)# existing_df &#61; pd.read_excel('C:/Apache24/flask/app/chat_bot/input_answer_data.xlsx')# updated_df &#61; pd.concat([existing_df, df], ignore_index&#61;True)# updated_df.to_excel('C:/Apache24/flask/app/chat_bot/input_answer_data.xlsx', index&#61;False)# if user_input &#61;&#61; &#34;&#34;: pass# else: # data_input(user_input,response,input_time) # reversed_history &#61; list(reversed(chat_history_1day))# return render_template('1day_chatbot.html', response&#61;response, chat_history&#61;reversed_history)# def ask(x, context&#61;'', is_input_full&#61;False):# ans &#61; pipe(# f&#34;### 질문: {x}

### 맥락: {context}

### 답변:&#34; if context else f&#34;### 질문: {x}

### 답변:&#34;,# do_sample&#61;True,# max_new_tokens&#61;256,# temperature&#61;0.7,# top_p&#61;0.9,# return_full_text&#61;False,# eos_token_id&#61;2,# )# response &#61; (ans[0]['generated_text']) return response큰 의미는 없겠지만 코드입니다. 각각 함수를 모은 코드, 실행코드 등 나누어서 실행시켰구요. 원래는 잘돌아가는 서버였는데 위 llm 모델을 사용하여 출력값을 확인해보려고 코드를 추가하면 아래와 같은 에러로그가 뜹니다.The 'Apache2.4' service has restarted.winnt:notice] [pid 8556:tid 360] AH00424: Parent: Received restart signal -- Restarting the server.[Thu Nov 09 10:24:42.921023 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00455: Apache/2.4.58 (Win64) mod_wsgi/4.9.4 Python/3.8 configured -- resuming normal operations[Thu Nov 09 10:24:42.921023 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00456: Apache Lounge VS17 Server built: Oct 18 2023 13:03:18[Thu Nov 09 10:24:42.921023 2023] [core:notice] [pid 8556:tid 360] AH00094: Command line: 'C:\Apache24\bin\httpd.exe -d C:/Apache24'[Thu Nov 09 10:24:42.923024 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00418: Parent: Created child process 15684[Thu Nov 09 10:24:43.918113 2023] [mpm_winnt:notice] [pid 15684:tid 344] AH00354: Child: Starting 64 worker threads.[Thu Nov 09 10:24:44.930051 2023] [mpm_winnt:notice] [pid 9492:tid 224] AH00364: Child: All worker threads have exited.[Thu Nov 09 10:24:50.502214 2023] [wsgi:error] [pid 15684:tid 1080] Loading checkpoint shards: 0%| | 0/13 [00:00<?, ?it/s][Thu Nov 09 10:24:50.629167 2023] [wsgi:error] [pid 15684:tid 1080] Loading checkpoint shards: 15%|\xe2\x96\x88\xe2\x96\x8c | 2/13 [00:00<00:00, 15.75it/s][Thu Nov 09 10:24:50.747539 2023] [wsgi:error] [pid 15684:tid 1080] Loading checkpoint shards: 31%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88 | 4/13 [00:00<00:00, 16.41it/s][Thu Nov 09 10:24:50.865696 2023] [wsgi:error] [pid 15684:tid 1080] Loading checkpoint shards: 46%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x8c | 6/13 [00:00<00:00, 16.64it/s][Thu Nov 09 10:24:50.995737 2023] [wsgi:error] [pid 15684:tid 1080] Loading checkpoint shards: 62%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x8f | 8/13 [00:00<00:00, 16.12it/s][Thu Nov 09 10:24:53.310171 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00428: Parent: child process 15684 exited with status 3221225477 -- Restarting.[Thu Nov 09 10:24:53.325179 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00455: Apache/2.4.58 (Win64) mod_wsgi/4.9.4 Python/3.8 configured -- resuming normal operations[Thu Nov 09 10:24:53.325179 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00456: Apache Lounge VS17 Server built: Oct 18 2023 13:03:18[Thu Nov 09 10:24:53.325179 2023] [core:notice] [pid 8556:tid 360] AH00094: Command line: 'C:\Apache24\bin\httpd.exe -d C:/Apache24'[Thu Nov 09 10:24:53.327180 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00418: Parent: Created child process 37968[Thu Nov 09 10:24:53.682225 2023] [mpm_winnt:notice] [pid 37968:tid 352] AH00354: Child: Starting 64 worker threads.[Thu Nov 09 10:29:40.595043 2023] [wsgi:error] [pid 37968:tid 1080] Loading checkpoint shards: 0%| | 0/13 [00:00<?, ?it/s][Thu Nov 09 10:29:40.727630 2023] [wsgi:error] [pid 37968:tid 1080] Loading checkpoint shards: 15%|\xe2\x96\x88\xe2\x96\x8c | 2/13 [00:00<00:00, 15.08it/s][Thu Nov 09 10:29:40.846886 2023] [wsgi:error] [pid 37968:tid 1080] Loading checkpoint shards: 31%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88 | 4/13 [00:00<00:00, 16.03it/s][Thu Nov 09 10:29:40.968548 2023] [wsgi:error] [pid 37968:tid 1080] Loading checkpoint shards: 46%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x8c | 6/13 [00:00<00:00, 16.28it/s][Thu Nov 09 10:29:41.084352 2023] [wsgi:error] [pid 37968:tid 1080] Loading checkpoint shards: 62%|\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x88\xe2\x96\x8f | 8/13 [00:00<00:00, 16.65it/s][Thu Nov 09 10:29:43.471472 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00428: Parent: child process 37968 exited with status 3221225477 -- Restarting.[Thu Nov 09 10:29:43.483524 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00455: Apache/2.4.58 (Win64) mod_wsgi/4.9.4 Python/3.8 configured -- resuming normal operations[Thu Nov 09 10:29:43.483524 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00456: Apache Lounge VS17 Server built: Oct 18 2023 13:03:18[Thu Nov 09 10:29:43.483524 2023] [core:notice] [pid 8556:tid 360] AH00094: Command line: 'C:\Apache24\bin\httpd.exe -d C:/Apache24'[Thu Nov 09 10:29:43.484525 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00418: Parent: Created child process 34784[Thu Nov 09 10:29:43.708387 2023] [mpm_winnt:notice] [pid 34784:tid 364] AH00354: Child: Starting 64 worker threads.[Thu Nov 09 10:34:03.910397 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00422: Parent: Received shutdown signal -- Shutting down the server.[Thu Nov 09 10:34:06.291156 2023] [mpm_winnt:notice] [pid 34784:tid 364] AH00364: Child: All worker threads have exited.[Thu Nov 09 10:34:06.744283 2023] [mpm_winnt:notice] [pid 8556:tid 360] AH00430: Parent: Child process 34784 exited successfully.[Thu Nov 09 10:34:31.780480 2023] [mpm_winnt:notice] [pid 4620:tid 316] AH00455: Apache/2.4.58 (Win64) mod_wsgi/4.9.4 Python/3.8 configured -- resuming normal operations[Thu Nov 09 10:34:31.796106 2023] [mpm_winnt:notice] [pid 4620:tid 316] AH00456: Apache Lounge VS17 Server built: Oct 18 2023 13:03:18[Thu Nov 09 10:34:31.796106 2023] [core:notice] [pid 4620:tid 316] AH00094: Command line: 'C:\Apache24\bin\httpd.exe -d C:/Apache24'[Thu Nov 09 10:34:31.796106 2023] [mpm_winnt:notice] [pid 4620:tid 316] AH00418: Parent: Created child process 6080[Thu Nov 09 10:34:32.108604 2023] [mpm_winnt:notice] [pid 6080:tid 332] AH00354: Child: Starting 64 worker threads.메모리 문제인건가요.?아파치 고수분들의 의견을 여쭙고싶습니다.

코알파카 LLM 모델을 아파치 플라스크에서 실행시키는데 에러로그를 봐도 무슨 에러인지 모르겠습니다.

0개의 답변

Q&A 목록