LCG-POB, 17.-18.2.2004, Reinhard Maschuw 1
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Grid Computing Centre Karlsruhe - GridKa
Regional/Tier 1 Centre of LCGat Forschungszentrum Karlsruhe
http://www.gridka.de
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 2
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
CMSATLAS
LHCbCERN
Tier 0 Centre at CERN
Working Groups
VirtualOrganizations
Tier 2(Uni-CCs,Lab-CCs)
Lab y
Uni a
Lab i
Uni b
Lab z
Lab x
Uni cUni d
Uni e
Tier 3 (Institute
computers)
Tier 4(Desktop)
The global LHC Computing
Centre
Germany(FZK)
Tier 1
USA(Fermi, BNL)
UK (RAL)
France(IN2P3)
Italy(CNAF)
……….
CERN Tier 1
……….Tier 0
The fifth “LHC experiment”
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 3
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
HEP experiments served by GridKa
Atlas (SLAC, USA)
(CERN)(FermiLab ,USA)
(FermiLab ,USA)
• Committed to Grid Computing
• Have real data already today
LHC experiments non-LHC experiments
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 4
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
GridKa
Technical Advisory Board
Overview Board
GridKa Project Organization
• Planning
• Development
• Technical realization
• Operation
• Alice
• Atlas
• CMS
• LHCb
• BaBar
• CDF
• D0
• Compass
• Physics Committees
• DESY
• Project Leader
• BMBF
• HEP Experiments
• LCG
• Physics Committees
• FZK Management
• Head FZK Comp. Centre
• Chairman of TAB
• Project Leader
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 5
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
German Users of GridKa
22 institutions
44 user groups
350 scientists
Aachen (4)●Bielefeld (2)●Bochum (2)●Bonn (3)●Darmstadt (1)▲Dortmund (1)●Dresden (2)●Erlangen (1)●Frankfurt (1)●Freiburg (2)●Hamburg (1)▲Heidelberg (1)▲(6)●Karlsruhe (2)●Mainz (3)●Mannheim (1)●München (1)●(5)▲Münster (1)●Rostock (1)●Siegen (1)●Wuppertal (2)●
▲
● University▲ other research institution() number of user groups
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 6
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
The five European Tier-1 Centres:
CERN (Geneva)
CNAF-INFN (Bologna)
FZK (Karlsruhe)
IN2P3 (Lyon)
RAL (Oxford)
Tier 2 Polen
Tier 2Östereich
Tier 2 Russland
German users of GridKa
• 19 institutions
• 41 user groups
• ~ 350 scientists
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 7
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
0
2000
4000
6000
8000
2002 2003 2004 2005 2006 2007 2008 2009
Tbyt
eGridKa planned hardware resources
4000
3000
2000
1000
0
kSI9
5
LCG Phase I Phase II Phase III
CPUDisk
Tape
460 CPUs118 TB disk220 TB tape
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 8
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Requirements for a complete Tier-1/Regional centre
CPUs3500
Disk1.6 PB
Tape4 PB
LAN
Server>150
WAN / Firewall 20 Gbps
Electricity & Cooling 1MW
Services & Development• GridKa management
• data management software
• data access optimization
• fabric management software
• LCG middleware
• Grid accounting software
• security policies
• certificate authority
• Global Grid User Support
• dissemination & training
• international collaboration
• .....Hardware• install, operate, maintain, replace
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 9
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
ESUS GOC
Local operations
GGUSInteraction Interaction
Interaction
Support request Support request
Experiment specific problems solved by Experiment Specific User Support (ESUS); Grid related problems sent to GGUS
Grid related problems solved by GGUS or transmitted to GOC; final report to ESUS
Global Grid User Support GridKa = European part of GGUS, one of three worldwide
http://www.ggus.org
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 10
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
GridKa – A 24x7 maintenance model
6
0/24
18
12
22
8
Grid (1st level) user support
To cover 365d x 16h per yr:
2 shifts per day
2 persons per shift
(covers illness)
= 1460 person days per yr
1 person year = 210 working days
7 persons required
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 11
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
GridKa Human Resources
0
10
20
30
40
50
60
2003 2004 2005 2006 2007 2008 2009
hu
man
res
ou
rces
/ F
TE
plannedhardwareresources
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 12
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Resource planning GridKA
2003 2004 2005 2006 2007 2008 2009
Personnel/FTE 15 15 30 38 39 43 43
Invest / k€ 1700 2000 1650 2350 3250 3950 3700
Phase I Phase II Phase III
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 13
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
~ 1.5 Million CPU hours29% LHC71% non- LHC
Usage of GridKa January - September 2003
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 14
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
~ 230.000 jobs
Number of user jobs January - September 2003
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 15
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Usage Example: LHCb Data Challenge’03 - ResultsUsage Example: LHCb Data Challenge’03 - Results
GridKa
N. B
rook, G
DB
9th
Sep
tem
ber 0
3
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 16
Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft
Summary and Conclusion
GridKa is a dedicated LCG regional centre
Requirements for all regional centres
• Planning of resources: investments, personnel, funding
• Definition of tasks and services
• Definition of relation to Tier 2 centres and others