Server Optimisation Request please

March 10th, 2010 by rose
  • Hope this information is OK Eva.

    1. Is this on dedicated or shared virual server. If shared, how many sites share this server:
    Dedicated

    2. theMouthPiece.com server specs:
    cpu speed/type single or dual cpus): Intel(R) Pentium(R) 4 CPU 2.80GHz
    how much memory installed: 1Gb
    hard drive type/configuration: 80GB EIDE non raid
    linux distributor or windows version: Red Hat Enterprise Linux ES release 4 (Nahant Update 3)
    apache/IIS version: apache 1.3.34
    PHP version: PHP 4.4.2
    MySQL version: MySQL 4.1.18

    3. if you use mysql 4.x instead of mysql 3.23.x, do you have any innodb type databases/tables on your server:
    No

    4. if possible how mysql was compiled/installed:
    RPM

    5. Top stats
    top - 11:51:51 up 50 days, 13:05, 1 user, load average: 0.67, 0.68, 0.92
    Tasks: 161 total, 1 running, 160 sleeping, 0 stopped, 0 zombie
    Cpu(s): 9.8% us, 1.4% sy, 0.4% ni, 74.6% id, 13.7% wa, 0.1% hi, 0.0% si
    Mem: 1027668k total, 471488k used, 556180k free, 832k buffers
    Swap: 2040244k total, 396636k used, 1643608k free, 45972k cached

    6. MySQL configuration variables located at /etc/my.cnf or c:my.cnf or my.ini so post the contents inside of my.cnf (minus any passwords of course).
    [mysqld]
    safe-show-database

    skip-locking
    safe-show-database
    skip-innodb

    interactive_timeout=10
    wait_timeout=20
    connect_timeout=10
    max_user_connections=25
    max_connections=500

    key_buffer=64M
    join_buffer=2M
    record_buffer=2M
    sort_buffer=4M
    max_allowed_packet=10M

    query_cache_limit = 2M
    query_cache_size = 64M
    query_cache_type = 1

    table_cache=2048
    thread_cache=256
    thread_concurrency=2

    [mysqld_safe]
    open_files_limit = 8192

    [mysqldump]
    quick
    max_allowed_packet = 16M

    [myisamchk]
    key_buffer = 64M
    sort_buffer = 64M
    read_buffer = 16M
    write_buffer = 16M

    7. MySQL stats from ssh telnet as root user type:
    Uptime: 82186 Threads: 1 Questions: 759270 Slow queries: 170 Opens: 4849 Flush tables: 1 Open tables: 2048 Queries per second avg: 9.238
    root@server [~]# mysqladmin var ext stat ver
    +---------------------------------+---------------------------------------------+
    Variable_name Value
    +---------------------------------+---------------------------------------------+
    back_log 50
    basedir /
    binlog_cache_size 32768
    bulk_insert_buffer_size 8388608
    character_set_client latin1
    character_set_connection latin1
    character_set_database latin1
    character_set_results latin1
    character_set_server latin1
    character_set_system utf8
    character_sets_dir /usr/share/mysql/charsets/
    collation_connection latin1_swedish_ci
    collation_database latin1_swedish_ci
    collation_server latin1_swedish_ci
    concurrent_insert ON
    connect_timeout 10
    datadir /var/lib/mysql/
    date_format %Y-%m-%d
    datetime_format %Y-%m-%d %H:%i:%s
    default_week_format 0
    delay_key_write ON
    delayed_insert_limit 100
    delayed_insert_timeout 300
    delayed_queue_size 1000
    expire_logs_days 0
    flush OFF
    flush_time 0
    ft_boolean_syntax + -><()~*:""&
    ft_max_word_len 84
    ft_min_word_len 4
    ft_query_expansion_limit 20
    ft_stopword_file (built-in)
    group_concat_max_len 1024
    have_archive NO
    have_bdb NO
    have_blackhole_engine NO
    have_compress YES
    have_crypt YES
    have_csv NO
    have_example_engine NO
    have_geometry YES
    have_innodb DISABLED
    have_isam NO
    have_ndbcluster NO
    have_openssl NO
    have_query_cache YES
    have_raid NO
    have_rtree_keys YES
    have_symlink YES
    init_connect
    init_file
    init_slave
    innodb_additional_mem_pool_size 1048576
    innodb_autoextend_increment 8
    innodb_buffer_pool_awe_mem_mb 0
    innodb_buffer_pool_size 8388608
    innodb_data_file_path
    innodb_data_home_dir
    innodb_fast_shutdown ON
    innodb_file_io_threads 4
    innodb_file_per_table OFF
    innodb_flush_log_at_trx_commit 1
    innodb_flush_method
    innodb_force_recovery 0
    innodb_lock_wait_timeout 50
    innodb_locks_unsafe_for_binlog OFF
    innodb_log_arch_dir
    innodb_log_archive OFF
    innodb_log_buffer_size 1048576
    innodb_log_file_size 5242880
    innodb_log_files_in_group 2
    innodb_log_group_home_dir
    innodb_max_dirty_pages_pct 90
    innodb_max_purge_lag 0
    innodb_mirrored_log_groups 1
    innodb_open_files 300
    innodb_table_locks ON
    innodb_thread_concurrency 8
    interactive_timeout 10
    join_buffer_size 2093056
    key_buffer_size 67108864
    key_cache_age_threshold 300
    key_cache_block_size 1024
    key_cache_division_limit 100
    language /usr/share/mysql/english/
    large_files_support ON
    license GPL
    local_infile ON
    locked_in_memory OFF
    log OFF
    log_bin OFF
    log_error
    log_slave_updates OFF
    log_slow_queries OFF
    log_update OFF
    log_warnings 1
    long_query_time 10
    low_priority_updates OFF
    lower_case_file_system OFF
    lower_case_table_names 0
    max_allowed_packet 10484736
    max_binlog_cache_size 4294967295
    max_binlog_size 1073741824
    max_connect_errors 10
    max_connections 500
    max_delayed_threads 20
    max_error_count 64
    max_heap_table_size 16777216
    max_insert_delayed_threads 20
    max_join_size 4294967295
    max_length_for_sort_data 1024
    max_relay_log_size 0
    max_seeks_for_key 4294967295
    max_sort_length 1024
    max_tmp_tables 32
    max_user_connections 25
    max_write_lock_count 4294967295
    myisam_data_pointer_size 4
    myisam_max_extra_sort_file_size 2147483648
    myisam_max_sort_file_size 2147483647
    myisam_recover_options OFF
    myisam_repair_threads 1
    myisam_sort_buffer_size 8388608
    myisam_stats_method nulls_unequal
    net_buffer_length 16384
    net_read_timeout 30
    net_retry_count 10
    net_write_timeout 60
    new OFF
    old_passwords OFF
    open_files_limit 4606
    pid_file /var/lib/mysql/server.themouthpiece.com.pid
    port 3306
    preload_buffer_size 32768
    protocol_version 10
    query_alloc_block_size 8192
    query_cache_limit 2097152
    query_cache_min_res_unit 4096
    query_cache_size 67108864
    query_cache_type ON
    query_cache_wlock_invalidate OFF
    query_prealloc_size 8192
    range_alloc_block_size 2048
    read_buffer_size 2093056
    read_only OFF
    read_rnd_buffer_size 262144
    relay_log_purge ON
    relay_log_space_limit 0
    rpl_recovery_rank 0
    secure_auth OFF
    server_id 0
    skip_external_locking ON
    skip_networking OFF
    skip_show_database OFF
    slave_net_timeout 3600
    slave_transaction_retries 0
    slow_launch_time 2
    socket /var/lib/mysql/mysql.sock
    sort_buffer_size 4194296
    sql_mode
    sql_notes OFF
    sql_warnings OFF
    storage_engine MyISAM
    sync_binlog 0
    sync_frm ON
    sync_replication 0
    sync_replication_slave_id 0
    sync_replication_timeout 0
    system_time_zone BST
    table_cache 2048
    table_type MyISAM
    thread_cache_size 256
    thread_stack 126976
    time_format %H:%i:%s
    time_zone SYSTEM
    tmp_table_size 33554432
    tmpdir
    transaction_alloc_block_size 8192
    transaction_prealloc_size 4096
    tx_isolation REPEATABLE-READ
    version 4.1.18-standard
    version_comment MySQL Community Edition - Standard (GPL)
    version_compile_machine i686
    version_compile_os pc-linux-gnu
    wait_timeout 20
    +---------------------------------+---------------------------------------------+
    +----------------------------+------------+
    Variable_name Value
    +----------------------------+------------+
    Aborted_clients 1030
    Aborted_connects 2315
    Binlog_cache_disk_use 0
    Binlog_cache_use 0
    Bytes_received 187634456
    Bytes_sent 4146637075
    Com_admin_commands 0
    Com_alter_db 0
    Com_alter_table 27
    Com_analyze 0
    Com_backup_table 0
    Com_begin 95
    Com_change_db 88990
    Com_change_master 0
    Com_check 0
    Com_checksum 0
    Com_commit 93
    Com_create_db 3
    Com_create_function 0
    Com_create_index 37
    Com_create_table 21
    Com_dealloc_sql 0
    Com_delete 3701
    Com_delete_multi 0
    Com_do 0
    Com_drop_db 0
    Com_drop_function 0
    Com_drop_index 0
    Com_drop_table 0
    Com_drop_user 0
    Com_execute_sql 0
    Com_flush 44
    Com_grant 23
    Com_ha_close 0
    Com_ha_open 0
    Com_ha_read 0
    Com_help 0
    Com_insert 20865
    Com_insert_select 126
    Com_kill 0
    Com_load 0
    Com_load_master_data 0
    Com_load_master_table 0
    Com_lock_tables 2112
    Com_optimize 0
    Com_preload_keys 0
    Com_prepare_sql 0
    Com_purge 0
    Com_purge_before_date 0
    Com_rename_table 0
    Com_repair 0
    Com_replace 11606
    Com_replace_select 0
    Com_reset 0
    Com_restore_table 0
    Com_revoke 2
    Com_revoke_all 0
    Com_rollback 1
    Com_savepoint 0
    Com_select 175709
    Com_set_option 5226
    Com_show_binlog_events 0
    Com_show_binlogs 0
    Com_show_charsets 0
    Com_show_collations 0
    Com_show_column_types 0
    Com_show_create_db 0
    Com_show_create_table 3975
    Com_show_databases 36
    Com_show_errors 0
    Com_show_fields 3989
    Com_show_grants 109
    Com_show_innodb_status 0
    Com_show_keys 0
    Com_show_logs 0
    Com_show_master_status 0
    Com_show_ndb_status 0
    Com_show_new_master 0
    Com_show_open_tables 0
    Com_show_privileges 0
    Com_show_processlist 281
    Com_show_slave_hosts 0
    Com_show_slave_status 0
    Com_show_status 10
    Com_show_storage_engines 0
    Com_show_tables 4093
    Com_show_variables 26
    Com_show_warnings 0
    Com_slave_start 0
    Com_slave_stop 0
    Com_stmt_close 0
    Com_stmt_execute 0
    Com_stmt_prepare 0
    Com_stmt_reset 0
    Com_stmt_send_long_data 0
    Com_truncate 0
    Com_unlock_tables 2128
    Com_update 60040
    Com_update_multi 56
    Connections 92310
    Created_tmp_disk_tables 3412
    Created_tmp_files 808
    Created_tmp_tables 9796
    Delayed_errors 0
    Delayed_insert_threads 0
    Delayed_writes 0
    Flush_commands 1
    Handler_commit 0
    Handler_delete 16231
    Handler_discover 0
    Handler_read_first 7124
    Handler_read_key 8622285
    Handler_read_next 19298685
    Handler_read_prev 2181034
    Handler_read_rnd 823816
    Handler_read_rnd_next 55574756
    Handler_rollback 0
    Handler_update 138337
    Handler_write 768176
    Key_blocks_not_flushed 0
    Key_blocks_unused 19965
    Key_blocks_used 38025
    Key_read_requests 25049768
    Key_reads 43311
    Key_write_requests 134086
    Key_writes 70133
    Max_used_connections 42
    Not_flushed_delayed_rows 0
    Open_files 3897
    Open_streams 0
    Open_tables 2048
    Opened_tables 4849
    Qcache_free_blocks 1913
    Qcache_free_memory 19248376
    Qcache_hits 286528
    Qcache_inserts 170926
    Qcache_lowmem_prunes 0
    Qcache_not_cached 735
    Qcache_queries_in_cache 7740
    Qcache_total_blocks 18729
    Questions 759418
    Rpl_status NULL
    Select_full_join 261
    Select_full_range_join 0
    Select_range 40733
    Select_range_check 0
    Select_scan 48122
    Slave_open_temp_tables 0
    Slave_retried_transactions 0
    Slave_running OFF
    Slow_launch_threads 0
    Slow_queries 170
    Sort_merge_passes 404
    Sort_range 20145
    Sort_rows 7339773
    Sort_scan 26686
    Table_locks_immediate 505551
    Table_locks_waited 1835
    Threads_cached 39
    Threads_connected 3
    Threads_created 42
    Threads_running 3
    Uptime 82193
    +----------------------------+------------+
    Uptime: 82193 Threads: 2 Questions: 759425 Slow queries: 170 Opens: 4849 Flush tables: 1 Open tables: 2048 Queries per second avg: 9.240
    mysqladmin Ver 8.41 Distrib 4.1.18, for pc-linux-gnu on i686
    (C) 2000 MySQL AB & MySQL Finland AB & TCX DataKonsult AB
    This software comes with ABSOLUTELY NO WARRANTY. This is free software,
    and you are welcome to modify and redistribute it under the GPL license

    Server version 4.1.18-standard
    Protocol version 10
    Connection Localhost via UNIX socket
    UNIX socket /var/lib/mysql/mysql.sock
    Uptime: 22 hours 49 min 53 sec

    Threads: 2 Questions: 759425 Slow queries: 170 Opens: 4849 Flush tables: 1 Open tables: 2048 Queries per second avg: 9.240

    8. Is your vB the only thing on the server? or other scripts & sites which utilise php and mysql?
    Other sites on my server also use php & mysql. These apps may include Mambo, Drupal and Wordpress.

    9. how many average and max concurrent users on your vB forum ? and what your cookie timeout is ?
    Average Users: 150
    Cookie Timeout: 1800

    10. create a file named phpinfo.php and place this code in it and post the url/link to it from your web site
    http://server.themouthpiece.com/phpinfo.php

    12. what version of vB are you running ?
    vB 3.5.2 - soon to be upgraded to 3.5.4

    13. check to see if any files i.e. apache log files are hitting 2GB or 4GB max file size limits i.e. see if you have max file size exceeded messages in apache error log
    None are

    14. Post output from these 3 commands

    uname -a
    Linux server.themouthpiece.com 2.6.9-34.EL #1 Fri Feb 24 16:44:51 EST 2006 i686 i686 i386 GNU/Linux

    ulimit -aH
    core file size (blocks, -c) 1000000
    data seg size (kbytes, -d) unlimited
    file size (blocks, -f) unlimited
    pending signals (-i) 1024
    max locked memory (kbytes, -l) 32
    max memory size (kbytes, -m) unlimited
    open files (-n) 4096
    pipe size (512 bytes, -p) 8
    POSIX message queues (bytes, -q) 819200
    stack size (kbytes, -s) 8192
    cpu time (seconds, -t) unlimited
    max user processes (-u) 14335
    virtual memory (kbytes, -v) unlimited
    file locks (-x) unlimited

    cat /proc/cpuinfo
    processor : 0
    vendor_id : GenuineIntel
    cpu family : 15
    model : 2
    model name : Intel(R) Pentium(R) 4 CPU 2.80GHz
    stepping : 9
    cpu MHz : 2799.052
    cache size : 512 KB
    fdiv_bug : no
    hlt_bug : no
    f00f_bug : no
    coma_bug : no
    fpu : yes
    fpu_exception : yes
    cpuid level : 2
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid xtpr
    bogomips : 5602.49


  • Seems you allocated too much memory to mysql my.cnf and swapping to disk by nearly 400MB.

    Try this reduced memory configuration for my.cnf below

    1. Edit /etc/my.cnf and place the following mysql server settings in /etc/my.cnf and restart mysql server afterwards


    [mysqld]
    safe-show-database
    back_log = 75
    skip-innodb
    max_connections = 500
    key_buffer = 32M
    myisam_sort_buffer_size = 64M
    join_buffer_size = 1M
    read_buffer_size = 1M
    sort_buffer_size = 2M
    table_cache = 1800
    thread_cache_size = 256
    wait_timeout = 60
    connect_timeout = 10
    tmp_table_size = 64M
    max_heap_table_size = 64M
    max_allowed_packet = 64M
    max_connect_errors = 10
    read_rnd_buffer_size = 524288
    bulk_insert_buffer_size = 8M
    query_cache_limit = 2M
    query_cache_size = 64M
    query_cache_type = 1
    query_prealloc_size = 163840
    query_alloc_block_size = 32768
    default-storage-engine = MyISAM

    [mysqld_safe]
    open_files_limit = 8192

    [mysqldump]
    quick
    max_allowed_packet = 16M

    [myisamchk]
    key_buffer = 64M
    sort_buffer = 64M
    read_buffer = 16M
    write_buffer = 16M

    [mysqlhotcopy]
    interactive-timeout


    2. Upgrade to vB 3.5.4 http://www.vbulletin.com/forum/showthread.php?t=176170 if you're on vB 3.5.x

    3. If you just upgraded to vB 3.5.x try to disable these 4 options:

    Admin CP -> vBulletin Options -> Forums Home Page Options -> Display Logged in Users?

    Admin CP -> vBulletin Options -> Forum Display Options (forumdisplay) -> Show Users Browsing Forums

    Admin CP -> vBulletin Options -> Thread Display Options -> Show Users Browsing Thread

    Admin CP -> vBulletin Options -> Message Searching Options -> Automatic Similar Thread search

    4. Then wait a few days then repost output for these 2 commands

    top

    mysqladmin -u root -p var ext ver > stats.txt

    open the stats.txt file to copy and paste it's contents.







  • #If you have any other info about this subject , Please add it free.#
    Your name:
    E-mail:
    Telphone:

    Your comments:


    If you have any other info about Server Optimisation Request please , Please add it free.

    Posted in enart.gcgx.com  |  edit

    Bulgaria-Italy: How many miles will Berbatov walk today? Xbox 360 fans ?????????????